00000001:02000400:3.0F:1788592468.252805:0:2958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788592477.627188:0:3160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788592478.608504:0:3222:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1263 MB/s 00000001:01000000:1.0:1788592478.858529:0:3222:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1399 MB/s 00000001:01000000:1.0:1788592479.108444:0:3222:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9635 MB/s 00000020:02000000:0.0F:1788592479.425074:0:3251:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_gae7f7f4 00000400:02000000:2.0F:1788592479.852947:0:3267:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.120@tcp [8/256/0/180] 00008000:02000000:2.0:1788592482.339899:0:3416:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788592533.917935:0:5228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788592546.988917:0:5804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788592546.988926:0:5804:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788592546.990207:0:5804:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c1032fcb 00000080:02000400:1.0:1788592546.990225:0:5804:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788592546.995386:0:5804:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788592546.995405:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788592546.995453:0:5804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fd593bb8) 00000020:00000080:1.0:1788592546.995480:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788592547.010570:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788592547.011069:0:5804:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788592547.032685:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788592547.032727:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788592547.032748:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788592547.032816:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788592547.032845:0:5804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788592547.033468:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788592547.033479:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788592547.033492:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f1325106ce 00000020:01000004:3.0:1788592547.033502:0:5804:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788592547.033508:0:5804:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788592547.033514:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c1032fcb from MGS 00000020:01000004:3.0:1788592547.033520:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788592547.033541:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007e7e4226) 00000020:00000080:3.0:1788592547.033556:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788592547.033677:0:5804:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c1032fcb from MGS, refs=2 00080000:01000000:3.0:1788592547.033685:0:5804:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788592547.033692:0:5804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f1325106dc 00000100:00100000:3.0:1788592547.033811:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788592547.034030:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788592547.034038:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788592547.034565:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788592547.034572:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788592547.035282:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592547.035667:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788592547.035673:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788592547.036302:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788592547.036311:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788592547.036694:0:5804:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788592547.036709:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788592547.037307:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592547.037310:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592547.037313:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592547.037674:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592547.037676:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592547.037678:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592547.038433:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788592547.040051:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788592547.287504:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2879 MB/s 00000001:01000000:2.0:1788592547.538524:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3603 MB/s 00000001:01000000:3.0:1788592547.789607:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 494 MB/s 00000001:01000000:2.0:1788592548.039694:0:5804:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 623 MB/s 00080000:10000000:2.0:1788592548.047823:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788592548.059142:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788592548.059164:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788592548.059167:0:5804:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788592548.060079:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788592548.060149:0:5804:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788592548.060196:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788592548.060483:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788592548.060510:0:5804:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788592548.060852:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592548.061612:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788592548.061621:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788592548.068158:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788592548.068177:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788592548.069174:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788592548.069186:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788592548.069777:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788592548.069802:0:5804:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:1.0:1788592548.069804:0:5804:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788592548.069860:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:1.0:1788592548.069873:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (00000000c26ddabe) 00000020:00000080:1.0:1788592548.069894:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1788592548.070082:0:5819:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788592548.071156:0:5804:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003eb75de5@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1788592548.071385:0:5804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:1.0:1788592548.071394:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788592548.073842:0:5820:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788592548.073936:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 3766d60d-7279-4c7a-a56f-5f796f49fe93) 00000020:00000080:0.0:1788592548.074034:0:5804:0:(genops.c:1385:class_connect()) connect: client 3766d60d-7279-4c7a-a56f-5f796f49fe93, cookie 0x27b316f1325106ea 00000100:00080000:0.0:1788592548.074052:0:5804:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592548.074059:0:5804:0:(import.c:665:import_select_connection()) MGC192.168.204.120@tcp: import 000000003eb75de5 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592548.074114:0:5804:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cab45e24 x1875475147260032/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592548.074244:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cab45e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3766d60d-7279-4c7a-a56f-5f796f49fe93:3282:1875475147260032:0@lo:250: 00000100:00100000:2.0:1788592548.074395:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592548.074483:0:5804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3766d60d-7279-4c7a-a56f-5f796f49fe93->MGS 00000020:01000004:0.0:1788592548.074510:0:5804:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788592548.074517:0:5804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788592548.074539:0:5804:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000070a664bc) 00000020:00000080:0.0:1788592548.074553:0:5804:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788592548.081477:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260032 00000100:00100000:3.0:1788592548.081499:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260032 00000100:00100000:3.0:1788592548.081541:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592548.081549:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6de9a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875475147260032:12345-0@lo:250: 00010000:00080000:3.0:1788592548.081594:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3766d60d-7279-4c7a-a56f-5f796f49fe93@0@lo t0 exp 0000000000000000 cur 122 last 0 00000020:00000080:3.0:1788592548.081632:0:5815:0:(genops.c:1385:class_connect()) connect: client 3766d60d-7279-4c7a-a56f-5f796f49fe93, cookie 0x27b316f1325106f8 00000100:00080000:3.0:1788592548.081826:0:5815:0:(import.c:65:import_set_state_nolock()) 0000000051a8aa97 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592548.086387:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6de9a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:3282:x1875475147260032:12345-0@lo:250: Request processed in 4826us (11982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592548.086406:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592548.089134:0:3282:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788592548.089162:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788592548.089173:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788592548.089180:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788592548.089184:0:3282:0:(import.c:65:import_set_state_nolock()) 000000003eb75de5 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788592548.089191:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788592548.089710:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788592548.089726:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cab45e24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3766d60d-7279-4c7a-a56f-5f796f49fe93:3282:1875475147260032:0@lo:250: 00010000:00010000:1.0:1788592548.100580:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592548.148853:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592548.149104:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788592548.149112:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788592548.154566:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788592548.154685:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788592548.155781:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592548.155792:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788592548.161507:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592548.161759:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788592548.161767:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788592548.164131:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788592548.164149:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788592548.269012:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592548.269249:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788592548.269256:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788592548.274222:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788592548.274250:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788592548.283219:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592548.283520:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592548.283528:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788592548.293004:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788592548.293031:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788592548.305083:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592548.305756:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592548.305777:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788592548.307250:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788592548.307265:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788592548.311784:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592548.312010:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592548.312018:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788592548.319402:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788592548.319428:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788592548.353306:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592548.353959:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788592548.353969:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788592548.355494:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788592548.355507:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788592548.357183:0:5804:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592548.357199:0:5804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788592548.358174:0:5804:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788592548.358206:0:5804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788592548.358214:0:5804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788592548.358636:0:5804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788592548.358681:0:5804:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788592548.358685:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788592548.358687:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592548.358692:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592548.358693:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592548.358694:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592548.358695:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592548.358696:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592548.358697:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592548.358698:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592548.358699:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592548.358700:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592548.358701:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592548.358704:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788592548.358706:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788592548.358707:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592548.358708:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592548.358709:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592548.358710:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592548.358711:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592548.358712:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592548.358712:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592548.358713:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592548.358714:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592548.358715:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592548.358715:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592548.358830:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788592548.358852:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022158de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260160:0@lo:253: 00000100:00100000:1.0:1788592548.358938:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592548.359052:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000005f184801 going to sleep for 11 seconds 00000100:00100000:0.0:1788592548.359140:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260160 00000100:00100000:0.0:1788592548.359150:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260160 00000100:00100000:0.0:1788592548.359204:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592548.359213:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000405cce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:5804:x1875475147260160:12345-0@lo:253: 20000000:01000000:0.0:1788592548.360194:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788592548.360201:0:5818:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788592548.360868:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788592548.360931:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788592548.361326:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592548.362293:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788592548.363046:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592548.363052:0:5818:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788592548.363058:0:5818:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788592548.363061:0:5818:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788592548.363075:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788592548.363648:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592548.364006:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788592548.364022:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788592548.364072:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788592548.364134:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788592548.364175:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788592548.364272:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788592548.364282:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788592548.364480:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788592548.364491:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788592548.364590:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788592548.364599:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788592548.364629:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788592548.364672:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788592548.364704:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788592548.364709:0:5818:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788592548.364790:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592548.364991:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788592548.365002:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788592548.365035:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788592548.365069:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788592548.365117:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788592548.365129:0:5818:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788592548.365198:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788592548.365207:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788592548.365251:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788592548.365287:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788592548.365430:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788592548.365443:0:5818:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788592548.365591:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788592548.365602:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788592548.365635:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788592548.365671:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788592548.365928:0:5818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788592548.365973:0:5818:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788592548.365980:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788592548.366601:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788592548.366978:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788592548.367004:0:5818:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.120@tcp for mdt 20000000:01000000:1.0:1788592548.367006:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:1.0:1788592548.367034:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788592548.367041:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788592548.367069:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788592548.367076:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:1.0:1788592548.367122:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788592548.367134:0:5818:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788592548.367166:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788592548.367202:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788592548.367262:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788592548.367265:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788592548.367270:0:5818:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788592548.367283:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788592548.367286:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788592548.367327:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788592548.367330:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788592548.371896:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788592548.372296:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788592548.372487:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788592548.372654:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788592548.372670:0:5818:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788592548.372673:0:5818:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788592548.373186:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788592548.373511:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788592548.373631:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788592548.373668:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788592548.373683:0:5818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592548.373686:0:5818:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788592548.373692:0:5818:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788592548.373694:0:5818:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788592548.373700:0:5818:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788592548.373715:0:5818:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788592548.374225:0:5843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788592548.374459:0:5818:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788592548.392070:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788592548.392152:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788592548.392241:0:5818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788592548.392268:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788592548.392293:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392324:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392336:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392343:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392380:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392388:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392394:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000996fbf81 already unused, calling callback (00000000beb12b7b) 00010000:00010000:0.0:1788592548.392399:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392407:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392422:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392429:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.392445:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000996fbf81/0x27b316f1325106ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592548.392470:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788592548.790208:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000405cce8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:5804:x1875475147260160:12345-0@lo:253: Request processed in 430982us (431257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592548.790227:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592548.790537:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022158de7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260160:0@lo:253: 10000000:01000000:0.0:1788592548.790557:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788592548.790560:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592548.790563:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788592548.790564:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592548.790565:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788592548.790566:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592548.790567:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592548.790569:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592548.790571:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788592548.790572:0:5804:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788592548.790574:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592548.790575:0:5804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788592548.790599:0:5804:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c1032fcb from lustre-MDT0000 10000000:01000000:0.0:1788592548.790634:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788592548.790637:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788592548.790642:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8981884acd40 10000000:01000000:0.0:1788592548.790647:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592548.790657:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8981884acd40 from 1 10000000:01000000:0.0:1788592548.790660:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788592548.790710:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.790723:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.790733:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592548.790767:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260288:0@lo:101: 00000100:00100000:0.0:1788592548.790811:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.790883:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788592548.791290:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260288 00000100:00100000:1.0:1788592548.791300:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260288 00000100:00100000:1.0:1788592548.791384:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592548.791393:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000982647df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:5804:x1875475147260288:12345-0@lo:101: 00010000:00010000:1.0:1788592548.791408:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592548.791426:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac628149/0x27b316f13251070d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510706 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.791455:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac628149/0x27b316f13251070d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510706 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.791467:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac628149/0x27b316f13251070d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510706 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.791476:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac628149, rc 0) 00000100:00100000:1.0:1788592548.791543:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000982647df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:5804:x1875475147260288:12345-0@lo:101: Request processed in 152us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592548.791550:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592548.791750:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260288:0@lo:101: 00010000:00010000:0.0:1788592548.791782:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.791793:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592548.791864:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260416:0@lo:501: 00000100:00100000:0.0:1788592548.791897:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.791942:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788592548.792069:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260416 00000100:00100000:3.0:1788592548.792076:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260416 00000100:00100000:3.0:1788592548.792112:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592548.792118:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a537170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:5804:x1875475147260416:12345-0@lo:501: 00000100:00100000:3.0:1788592548.792456:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a537170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:5804:x1875475147260416:12345-0@lo:501: Request processed in 337us (559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592548.792464:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592548.792918:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260416:0@lo:501: 10000000:01000000:0.0:1788592548.792963:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788592548.792983:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.792995:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000996fbf81/0x27b316f132510706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592548.793005:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff898190067800 10000000:01000000:0.0:1788592548.793010:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788592548.793016:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff898190067800 10000000:01000000:0.0:1788592548.793018:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788592548.793021:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff898190067800 from 1 10000000:01000000:0.0:1788592548.793034:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788592548.793064:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793072:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793082:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592548.793097:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260544:0@lo:101: 00000100:00100000:0.0:1788592548.793131:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.793169:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788592548.793291:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260544 00000100:00100000:1.0:1788592548.793299:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260544 00000100:00100000:1.0:1788592548.793373:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592548.793381:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6326f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:5804:x1875475147260544:12345-0@lo:101: 00010000:00010000:1.0:1788592548.793391:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592548.793403:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050b1ad57/0x27b316f13251071b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510714 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.793436:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050b1ad57/0x27b316f13251071b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510714 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.793446:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050b1ad57/0x27b316f13251071b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510714 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.793454:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050b1ad57, rc 0) 00000100:00100000:1.0:1788592548.793502:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6326f11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+7:5804:x1875475147260544:12345-0@lo:101: Request processed in 123us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592548.793508:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592548.793748:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260544:0@lo:101: 00010000:00010000:0.0:1788592548.793760:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793768:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592548.793782:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788592548.793798:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793806:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000004437cf82/0x27b316f132510714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592548.793813:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788592548.793817:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592548.793823:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff898190067800 10000000:01000000:0.0:1788592548.793833:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788592548.793836:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788592548.793838:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788592548.793855:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793861:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.793868:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592548.793881:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260672:0@lo:101: 00000100:00100000:0.0:1788592548.793978:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.794006:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:1.0:1788592548.794113:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260672 00000100:00100000:1.0:1788592548.794120:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260672 00000100:00100000:1.0:1788592548.794156:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592548.794163:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008f93928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+7:5804:x1875475147260672:12345-0@lo:101: 00010000:00010000:1.0:1788592548.794172:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592548.794182:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9cb1e65/0x27b316f132510729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510722 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.794196:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9cb1e65/0x27b316f132510729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510722 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.794203:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9cb1e65/0x27b316f132510729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510722 expref: 8 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592548.794211:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9cb1e65, rc 0) 00000100:00100000:1.0:1788592548.794249:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008f93928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+8:5804:x1875475147260672:12345-0@lo:101: Request processed in 86us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592548.794255:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592548.796100:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260672:0@lo:101: 00010000:00010000:0.0:1788592548.796134:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592548.796147:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592548.796239:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260800:0@lo:501: 00000100:00100000:0.0:1788592548.796300:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.796405:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:2.0:1788592548.796513:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260800 00000100:00100000:2.0:1788592548.796520:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260800 00000100:00100000:2.0:1788592548.796583:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592548.796591:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff82592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+8:5804:x1875475147260800:12345-0@lo:501: 00000100:00100000:2.0:1788592548.796925:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff82592c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5804:x1875475147260800:12345-0@lo:501: Request processed in 334us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592548.796933:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592548.797153:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260800:0@lo:501: 00000100:00100000:0.0:1788592548.797191:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260928:0@lo:503: 00000100:00100000:0.0:1788592548.797236:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.797277:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788592548.797387:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147260928 00000100:00100000:3.0:1788592548.797393:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147260928 00000100:00100000:3.0:1788592548.797426:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592548.797432:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095412222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5804:x1875475147260928:12345-0@lo:503: 00000100:00100000:3.0:1788592548.797622:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095412222 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5804:x1875475147260928:12345-0@lo:503: Request processed in 190us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592548.797630:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592548.797853:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147260928:0@lo:503: 00000100:00100000:0.0:1788592548.799080:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5845:1875475147261056:0@lo:502: 00000100:00100000:0.0:1788592548.799158:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592548.799241:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f92ca545 going to sleep for 11 seconds 00000100:00100000:3.0:1788592548.806740:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261056 00000100:00100000:3.0:1788592548.806762:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261056 00000100:00100000:3.0:1788592548.806914:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788592548.806927:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6fb2da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5845:x1875475147261056:12345-0@lo:502: 00000100:00100000:3.0:1788592548.807312:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6fb2da1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5845:x1875475147261056:12345-0@lo:502: Request processed in 378us (8144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592548.807322:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592548.808438:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5845:1875475147261056:0@lo:502: 00000020:01000000:0.0:1788592548.808504:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592548.808521:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592548.808525:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788592548.808531:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788592548.808534:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592548.808554:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000024a8b8d6) 00000020:00000080:0.0:1788592548.808580:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788592548.808587:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788592548.808721:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788592548.808730:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132510737 00000020:00000080:0.0:1788592548.808998:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788592548.809003:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592548.809007:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592548.809009:0:5845:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788592548.809011:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592548.809015:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592548.809016:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788592548.809019:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592548.809025:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009f9393a4) 00000020:00000080:0.0:1788592548.809035:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788592548.809038:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788592548.809040:0:5845:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788592548.809043:0:5845:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788592548.809050:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788592548.809100:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c1032fcb from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788592548.809119:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000adffed7b) 00000020:00000080:0.0:1788592548.809128:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788592548.809186:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788592548.809193:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f13251074c 00000020:00000080:0.0:1788592548.809317:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788592548.809324:0:5845:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788592548.809329:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27b316f132510753 00080000:01000000:0.0:1788592548.809334:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788592548.809337:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f13251075a 00080000:10000000:0.0:1788592548.809903:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788592548.810138:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788592548.821793:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788592549.051904:0:5845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788592549.052337:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788592549.063315:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788592549.063895:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1788592549.123617:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788592549.132678:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005deda92b) 00000020:00000080:0.0:1788592549.132711:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788592549.132817:0:5845:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788592549.132827:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132510768 00000020:00000080:2.0:1788592549.137129:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788592549.139938:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788592549.194849:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788592549.261671:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592549.333253:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788592549.387420:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788592549.450851:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788592549.508301:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27b316f13251076f 00000020:00000080:1.0:1788592549.509257:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788592549.509273:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592549.509281:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592549.509284:0:5845:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788592549.509299:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592549.509306:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592549.509308:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788592549.509311:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592549.509313:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788592549.509316:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592549.509319:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592549.509320:0:5845:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788592549.509322:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592549.509328:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592549.509330:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788592549.509335:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788592549.509409:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788592549.509478:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5845:1875475147261184:0@lo:502: 00000100:00100000:1.0:1788592549.509602:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592549.509663:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000505e5d94 going to sleep for 11 seconds 00000100:00100000:2.0:1788592549.509805:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261184 00000100:00100000:2.0:1788592549.509814:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261184 00000100:00100000:2.0:1788592549.509863:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592549.509871:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007147aea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5845:x1875475147261184:12345-0@lo:502: 00000100:00100000:2.0:1788592549.510520:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007147aea7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5845:x1875475147261184:12345-0@lo:502: Request processed in 647us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592549.510529:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592549.510659:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5845:1875475147261184:0@lo:502: 00000020:01000000:1.0:1788592549.510690:0:5845:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592549.510697:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592549.510699:0:5845:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788592549.510703:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788592549.510885:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788592549.510968:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788592549.510993:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.511005:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000827a04ab/0x27b316f132510722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592549.511012:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff898190067800 from 1 10000000:01000000:2.0:1788592549.511016:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592549.511065:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.511074:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.511095:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592549.511112:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087cb2da3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261312:0@lo:101: 00000100:00100000:2.0:1788592549.511150:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592549.511257:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000007587f057 going to sleep for 11 seconds 00000100:00100000:3.0:1788592549.511377:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261312 00000100:00100000:3.0:1788592549.511385:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261312 00000100:00100000:3.0:1788592549.511418:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592549.511425:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e63e0fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:5804:x1875475147261312:12345-0@lo:101: 00010000:00010000:3.0:1788592549.511436:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592549.511453:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510776 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.511489:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510776 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.511499:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510776 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.511507:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c6287cc8, rc 0) 00000100:00100000:3.0:1788592549.511540:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e63e0fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:5804:x1875475147261312:12345-0@lo:101: Request processed in 116us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592549.511546:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592549.511637:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087cb2da3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261312:0@lo:101: 00010000:00010000:2.0:1788592549.511650:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.511658:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592549.512516:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000087cb2da3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261440:0@lo:256: 00000100:00100000:2.0:1788592549.512570:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592549.512638:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000007587f057 going to sleep for 11 seconds 00000100:00100000:1.0:1788592549.512852:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261440 00000100:00100000:1.0:1788592549.512860:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261440 00000100:00100000:1.0:1788592549.512999:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788592549.513007:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000629504d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:5804:x1875475147261440:12345-0@lo:256: 20000000:01000000:1.0:1788592549.513028:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788592549.513041:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788592549.513130:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000629504d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:5804:x1875475147261440:12345-0@lo:256: Request processed in 125us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592549.513139:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592549.513288:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000087cb2da3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261440:0@lo:256: 10000000:01000000:0.0:1788592549.513951:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788592549.513970:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.513982:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592549.513991:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898190067800 from 1 10000000:01000000:0.0:1788592549.513994:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592549.514039:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.514047:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.514056:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.514076:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261568:0@lo:101: 00000100:00100000:0.0:1788592549.514125:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.514147:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b51df57 going to sleep for 11 seconds 00000100:00100000:1.0:1788592549.514408:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261568 00000100:00100000:1.0:1788592549.514416:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261568 00000100:00100000:1.0:1788592549.514452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592549.514459:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077d29ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:5804:x1875475147261568:12345-0@lo:101: 00010000:00010000:1.0:1788592549.514470:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592549.514485:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510784 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592549.514506:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510784 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592549.514517:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510784 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592549.514526:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c5b6274, rc 0) 00000100:00100000:1.0:1788592549.514564:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077d29ed0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261568:12345-0@lo:101: Request processed in 106us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592549.514571:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592549.514660:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261568:0@lo:101: 00010000:00010000:0.0:1788592549.514672:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.514681:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.514736:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261696:0@lo:501: 00000100:00100000:0.0:1788592549.514763:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.514792:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b51df57 going to sleep for 11 seconds 00000100:00100000:1.0:1788592549.514832:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261696 00000100:00100000:1.0:1788592549.514837:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261696 00000100:00100000:1.0:1788592549.514853:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592549.514857:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e457ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261696:12345-0@lo:501: 00000100:00100000:1.0:1788592549.515721:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e457ccf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261696:12345-0@lo:501: Request processed in 860us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592549.515732:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592549.515882:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261696:0@lo:501: 00000100:00100000:0.0:1788592549.515998:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261824:0@lo:503: 00000100:00100000:0.0:1788592549.516040:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.516075:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b51df57 going to sleep for 11 seconds 00000100:00100000:3.0:1788592549.516150:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261824 00000100:00100000:3.0:1788592549.516228:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261824 00000100:00100000:3.0:1788592549.516259:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592549.516265:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d3ba3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261824:12345-0@lo:503: 00000040:00080000:3.0:1788592549.516319:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592549.516383:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d3ba3b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261824:12345-0@lo:503: Request processed in 118us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592549.516390:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592549.516514:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261824:0@lo:503: 00000040:00080000:0.0:1788592549.518456:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788592549.518687:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788592549.518709:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592549.518733:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.518748:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592549.518803:0:5804:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788592549.518806:0:5804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff898190067800 10000000:01000000:2.0:1788592549.518809:0:5804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff898190067800 10000000:01000000:2.0:1788592549.518819:0:5804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592549.518827:0:5804:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898190067800 from 1 10000000:01000000:2.0:1788592549.518830:0:5804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592549.518871:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.518879:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.519023:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592549.519053:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d4a28bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261952:0@lo:101: 00000100:00100000:2.0:1788592549.519136:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592549.519246:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147261952 00000100:00100000:3.0:1788592549.519256:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147261952 00000100:00100000:3.0:1788592549.519325:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592549.519334:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067d0a9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147261952:12345-0@lo:101: 00010000:00010000:3.0:1788592549.519373:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592549.519387:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000060452712/0x27b316f132510799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510792 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.519414:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000060452712/0x27b316f132510799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.519434:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000060452712/0x27b316f132510799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.519443:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000060452712, rc 0) 00000100:00100000:3.0:1788592549.520065:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067d0a9ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147261952:12345-0@lo:101: Request processed in 729us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592549.520076:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592549.520228:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f30cc479 going to sleep for 11 seconds 00000100:00100000:2.0:1788592549.520257:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d4a28bf8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147261952:0@lo:101: 00010000:00010000:2.0:1788592549.520276:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592549.520287:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.520883:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262080:0@lo:501: 00000100:00100000:0.0:1788592549.521005:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.521074:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a0be466f going to sleep for 11 seconds 00000100:00100000:2.0:1788592549.521117:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262080 00000100:00100000:2.0:1788592549.521123:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262080 00000100:00100000:2.0:1788592549.521265:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592549.521274:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9cd0319 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147262080:12345-0@lo:501: 00000100:00100000:2.0:1788592549.521675:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9cd0319 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147262080:12345-0@lo:501: Request processed in 402us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592549.521683:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788592549.521785:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002dcb4e2d pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262080:0@lo:501: 00000100:00100000:1.0:1788592549.521827:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262208:0@lo:503: 00000100:00100000:1.0:1788592549.521866:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592549.522114:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc35a8f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788592549.522230:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262208 00000100:00100000:0.0:1788592549.522236:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262208 00000100:00100000:0.0:1788592549.522265:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592549.522271:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cffcd442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147262208:12345-0@lo:503: 00000100:00100000:0.0:1788592549.522643:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cffcd442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147262208:12345-0@lo:503: Request processed in 371us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592549.522651:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592549.522778:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262208:0@lo:503: 00000100:00100000:0.0:1788592549.523277:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000012a3d011 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5850:1875475147262336:0@lo:502: 00000100:00100000:0.0:1788592549.523332:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.523386:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 000000000d3669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592549.523448:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262336 00000100:00100000:1.0:1788592549.523454:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262336 00000100:00100000:1.0:1788592549.523482:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592549.523488:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002343f251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5850:x1875475147262336:12345-0@lo:502: 00000100:00100000:1.0:1788592549.523733:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002343f251 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5850:x1875475147262336:12345-0@lo:502: Request processed in 245us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592549.523740:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592549.524378:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000012a3d011 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5850:1875475147262336:0@lo:502: 00000020:01000004:0.0:1788592549.524451:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788592549.524468:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b885279d) 00000020:00000080:0.0:1788592549.524490:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788592549.524572:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c1032fcb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592549.524577:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c1032fcb from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592549.524580:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c1032fcb 4 00010000:00080000:0.0:1788592549.524611:0:5850:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f56b89d7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1788592549.529867:0:5850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788592549.530342:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788592549.530443:0:5850:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788592549.530458:0:5850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27b316f1325107a7 00000100:00080000:1.0:1788592549.530471:0:5850:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788592549.530477:0:5850:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f56b89d7 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592549.530520:0:5850:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002ef3fdd0 x1875475147262464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592549.530542:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788592549.530845:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147262464:0@lo:38: 00000100:00100000:0.0:1788592549.531010:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592549.531134:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262464 00000100:00100000:3.0:1788592549.531143:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262464 00000100:00100000:3.0:1788592549.531191:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592549.531198:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012a3d011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147262464:12345-0@lo:38: 00000100:00100000:3.0:1788592549.531257:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012a3d011 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147262464:12345-0@lo:38: Request processed in 59us (248us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788592549.531265:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592549.531418:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788592549.531428:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000f56b89d7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788592549.531433:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788592549.531436:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002ef3fdd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147262464:0@lo:38: 00000100:00100000:1.0:1788592549.531855:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000414cf472 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5850:1875475147262592:0@lo:502: 00000100:00100000:1.0:1788592549.532077:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592549.532167:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9a005f1 going to sleep for 11 seconds 00000100:00100000:0.0:1788592549.534248:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262592 00000100:00100000:0.0:1788592549.534266:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262592 00000100:00100000:0.0:1788592549.534343:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592549.534459:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007983b7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5850:x1875475147262592:12345-0@lo:502: 00000100:00100000:0.0:1788592549.534808:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007983b7fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5850:x1875475147262592:12345-0@lo:502: Request processed in 352us (2730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592549.534817:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592549.534946:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000414cf472 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:5850:1875475147262592:0@lo:502: 00000040:00080000:2.0:1788592549.534992:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788592549.535298:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788592549.535320:0:5804:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592549.535338:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.535386:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 000000009bb1cec5/0x27b316f132510792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592549.535444:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592549.535447:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788592549.535448:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592549.535449:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592549.535451:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592549.535453:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592549.535455:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592549.535457:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788592549.535460:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592549.535461:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592549.535463:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592549.535466:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592549.535470:0:5804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788592549.535473:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592549.535474:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788592549.535476:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592549.535477:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592549.535478:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592549.535484:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592549.535485:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788592549.535486:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788592549.535486:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592549.535487:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592549.535488:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592549.535489:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592549.535510:0:5804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788592549.535527:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc8bd80a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262720:0@lo:253: 00000100:00100000:0.0:1788592549.535601:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.535635:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 00000000982fe44c going to sleep for 11 seconds 00000100:00100000:3.0:1788592549.536962:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262720 00000100:00100000:3.0:1788592549.536976:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262720 00000100:00100000:3.0:1788592549.537048:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592549.537057:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eeecf45c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5804:x1875475147262720:12345-0@lo:253: 20000000:01000000:3.0:1788592549.537090:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788592549.537106:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788592549.585066:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788592549.585090:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788592549.585164:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788592549.585170:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788592549.585198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.585221:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510776 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.585230:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.585326:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510776 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592549.585342:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510776 expref: 12 pid: 5815 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592549.585377:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000b6dd86e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147262848:0@lo:104: 00000100:00100000:3.0:1788592549.585464:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592549.585536:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8551c6c going to sleep for 11 seconds 00000100:00100000:0.0:1788592549.586096:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262848 00000100:00100000:0.0:1788592549.586108:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262848 00000100:00100000:0.0:1788592549.586177:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592549.586186:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071abc16f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147262848:12345-0@lo:104: 00010000:00010000:0.0:1788592549.586202:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586273:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592549.586279:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071abc16f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147262848:12345-0@lo:104: Request processed in 95us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592549.586297:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788592549.586320:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592549.586325:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586333:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d8988f23 already unused, calling callback (00000000961c5379) 10000000:00010000:0.0:1788592549.586337:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586385:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592549.586392:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592549.586398:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592549.586433:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586440:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592549.586459:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586466:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 00000000d8988f23/0x27b316f132510776 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251077d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586487:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592549.586488:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592549.586490:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592549.586589:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c344a556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147262976:0@lo:103: 00000100:00100000:0.0:1788592549.586624:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592549.586698:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147262976 00000100:00100000:0.0:1788592549.586703:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147262976 00010000:00010000:0.0:1788592549.586720:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510776 expref: 13 pid: 5815 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.586742:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592549.586748:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000193a3ff6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3284:x1875475147262976:12345-0@lo:103: 00010000:00010000:0.0:1788592549.586765:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592549.586769:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510776 expref: 13 pid: 5815 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586779:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510776 expref: 13 pid: 5815 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586798:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586805:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592549.586819:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001650341s 00010000:00010000:0.0:1788592549.586823:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586830:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586837:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586843:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586849:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b27e815d already unused, calling callback (00000000beb12b7b) 00010000:00010000:0.0:1788592549.586853:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586861:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586874:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.586884:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592549.586926:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000193a3ff6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3284:x1875475147262976:12345-0@lo:103: Request processed in 179us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592549.586933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592549.586973:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c344a556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147262976:0@lo:103: 00010000:00010000:0.0:1788592549.587005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c6287cc8/0x27b316f13251077d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510776 expref: 12 pid: 5815 timeout: 273 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.587016:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000b6dd86e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147262848:0@lo:104: 00010000:00010000:0.0:1788592549.587028:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.587037:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.587042:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592549.587047:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b27e815d/0x27b316f1325107ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592549.597756:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eeecf45c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5804:x1875475147262720:12345-0@lo:253: Request processed in 60689us (62143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592549.597775:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592549.598033:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc8bd80a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:5804:1875475147262720:0@lo:253: 10000000:01000000:2.0:1788592549.598052:0:5804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788592549.598056:0:5804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592549.598058:0:5804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592549.598060:0:5804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592549.598061:0:5804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592549.598062:0:5804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592549.598063:0:5804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592549.598065:0:5804:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592549.598066:0:5804:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592549.598068:0:5804:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592549.598069:0:5804:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592549.598070:0:5804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592549.598072:0:5804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788592549.598089:0:5804:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788592549.603059:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.604170:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592549.604514:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.604696:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592549.605307:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.605633:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592549.606557:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.606737:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592549.607012:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.607194:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592549.607511:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592549.607995:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788592549.652995:0:5804:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788592549.688438:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788592549.688806:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788592549.692104:0:5855:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788592549.692115:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788592549.692828:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788592549.693204:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788592549.693715:0:5804:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788592549.693726:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788592549.694114:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592549.695300:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788592549.696221:0:5804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788592549.696271:0:5804:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788592549.696676:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788592549.697057:0:5804:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788592549.700024:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788592549.700284:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788592549.700485:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788592549.700661:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788592549.700798:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788592549.700959:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788592549.701145:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788592549.701313:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788592549.701484:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788592549.701633:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788592549.701811:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788592549.701966:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788592549.702127:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788592549.702318:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788592549.702505:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788592549.702686:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788592549.703018:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788592549.707620:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788592549.707836:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788592549.708021:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788592549.708186:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788592549.708390:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788592549.708553:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788592549.708702:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788592549.708867:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788592549.709022:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788592549.709176:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788592549.709389:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788592549.709544:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788592549.709699:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788592549.709900:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788592549.710074:0:5804:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788592549.710600:0:5804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788592549.752490:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788592549.808115:0:5804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788592549.808175:0:5804:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe201cbb988 00100000:10000000:0.0:1788592549.808186:0:5804:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788592549.812119:0:5804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788592549.812666:0:5804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788592549.812696:0:5804:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788592549.812862:0:5804:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1788592549.883393:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788592549.883503:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788592549.883508:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788592550.143521:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592551.168309:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592552.192503:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592553.214773:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592554.247134:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592554.634865:0:6099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788592554.751830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788592554.751841:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788592554.751845:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f56b89d7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592554.751862:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f56b89d7 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592554.751893:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a9f3dd7 x1875475147263232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788592554.752011:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c344a556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147263104:0@lo:400: 00000100:00100000:2.0:1788592554.752011:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a9f3dd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147263232:0@lo:38: 00000100:00100000:2.0:1788592554.752119:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592554.752121:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592554.752260:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263104 00000100:00100000:1.0:1788592554.752271:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263104 00000100:00100000:1.0:1788592554.752400:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592554.752410:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d20c09b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3285:x1875475147263104:12345-0@lo:400: 00000100:00100000:1.0:1788592554.752477:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d20c09b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3285:x1875475147263104:12345-0@lo:400: Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592554.753081:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592554.753312:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263232 00000100:00100000:1.0:1788592554.753319:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263232 00000100:00100000:1.0:1788592554.753382:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592554.753389:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a28bf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875475147263232:12345-0@lo:38: 00010000:00080000:1.0:1788592554.753417:0:5824:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 128 last 0 00000020:00000080:1.0:1788592554.753458:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27b316f1325107b5 00000004:00100000:1.0:1788592554.754044:0:5824:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592554.754235:0:5824:0:(import.c:65:import_set_state_nolock()) 00000000f084ff9f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592554.756037:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c344a556 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147263104:0@lo:400: 00000100:00100000:1.0:1788592554.756273:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a28bf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875475147263232:12345-0@lo:38: Request processed in 2882us (4157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592554.756286:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592554.756539:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000a9f3dd7 x1875475147263232/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788592554.756560:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788592554.756585:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788592554.756591:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788592554.756595:0:3282:0:(import.c:65:import_set_state_nolock()) 00000000f56b89d7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592554.756603:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a9f3dd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147263232:0@lo:38: 00010000:00010000:0.0:1788592555.265550:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592555.776154:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592555.776165:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff898190067800 from 3 10000000:01000000:3.0:1788592555.776180:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592555.776239:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592555.776253:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592555.776265:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592555.776293:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000036771e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147263360:0@lo:101: 00000100:00100000:3.0:1788592555.776403:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592555.776458:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ae24a18 going to sleep for 11 seconds 00000100:00100000:0.0:1788592555.776691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263360 00000100:00100000:0.0:1788592555.776701:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263360 00000100:00100000:0.0:1788592555.776767:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592555.776777:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e4441e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5820:x1875475147263360:12345-0@lo:101: 00010000:00010000:0.0:1788592555.776793:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592555.776808:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff8c5c6c/0x27b316f1325107c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325107bc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592555.776834:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff8c5c6c/0x27b316f1325107c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325107bc expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592555.776846:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff8c5c6c/0x27b316f1325107c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325107bc expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592555.776878:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff8c5c6c, rc 0) 00000100:00100000:0.0:1788592555.776928:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e4441e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147263360:12345-0@lo:101: Request processed in 153us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592555.776936:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788592555.778188:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000036771e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147263360:0@lo:101: 00010000:00010000:0.0:1788592555.778215:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592555.778227:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592555.779221:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006808fb00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147263488:0@lo:256: 00000100:00100000:0.0:1788592555.779295:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592555.779365:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a18e03c going to sleep for 11 seconds 00000100:00100000:3.0:1788592555.779541:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263488 00000100:00100000:3.0:1788592555.779549:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263488 00000100:00100000:3.0:1788592555.779604:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592555.779612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000102e0c4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147263488:12345-0@lo:256: 20000000:01000000:3.0:1788592555.779636:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788592555.779655:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788592555.779658:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788592555.779752:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000102e0c4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147263488:12345-0@lo:256: Request processed in 141us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592555.779760:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592555.780139:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006808fb00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147263488:0@lo:256: 10000000:01000000:1.0:1788592555.780208:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592555.780218:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592555.780228:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: 0000000013366918/0x27b316f1325107bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592556.294119:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592557.311589:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592558.334569:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592559.358897:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592559.871235:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000734c73b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147263744:0@lo:400: 00000100:00100000:3.0:1788592559.871327:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592559.871443:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263744 00000100:00100000:3.0:1788592559.871453:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263744 00000100:00100000:3.0:1788592559.871500:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592559.871506:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ae250ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147263744:12345-0@lo:400: 00000100:00100000:3.0:1788592559.871558:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ae250ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147263744:12345-0@lo:400: Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592559.871565:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788592559.871603:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000734c73b6 x1875475147263744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592559.871618:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000734c73b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147263744:0@lo:400: 00000100:00100000:2.0:1788592559.871707:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592559.871719:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001dcd8f5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147263616:0@lo:400: 00000100:00100000:2.0:1788592559.871758:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592559.871792:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263616 00000100:00100000:2.0:1788592559.871796:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263616 00000100:00100000:2.0:1788592559.871823:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592559.871828:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7494c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3285:x1875475147263616:12345-0@lo:400: 00000100:00100000:2.0:1788592559.871855:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7494c18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3285:x1875475147263616:12345-0@lo:400: Request processed in 28us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592559.871861:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592559.871896:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001dcd8f5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147263616:0@lo:400: 00000020:00000080:0.0:1788592559.890058:0:6301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe82aafec0 20000000:00000080:0.0:1788592559.890084:0:6301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8981984aec00 uarg=0000000000000000 20000000:01000000:0.0:1788592559.890141:0:6301:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788592559.890150:0:6301:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788592559.890156:0:6301:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788592559.891651:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788592559.891670:0:6301:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788592559.894926:0:6301:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592559.895197:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788592559.895258:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788592559.895297:0:6301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788592559.895322:0:6301:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788592559.895344:0:6301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.895390:0:6301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510784 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.895397:0:6301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.895454:0:6301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510784 expref: 11 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.895469:0:6301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510784 expref: 11 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592559.895482:0:6301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b9fb1fbe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875475147263872:0@lo:104: 00000100:00100000:2.0:1788592559.895558:0:6301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592559.895630:0:6301:0:(client.c:2716:ptlrpc_set_wait()) set 0000000007e93bfc going to sleep for 11 seconds 00000100:00100000:3.0:1788592559.895810:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147263872 00000100:00100000:3.0:1788592559.895820:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147263872 00000100:00100000:3.0:1788592559.895875:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592559.895884:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a684be5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:6301:x1875475147263872:12345-0@lo:104: 00010000:00010000:3.0:1788592559.895899:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592559.895974:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592559.895980:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a684be5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:6301:x1875475147263872:12345-0@lo:104: Request processed in 97us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592559.895987:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592559.896088:0:6301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b9fb1fbe pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6301:1875475147263872:0@lo:104: 00010000:00010000:1.0:1788592559.896124:0:6301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897192:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592559.897203:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897212:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072344c62 already unused, calling callback (00000000961c5379) 10000000:00010000:0.0:1788592559.897215:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897242:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592559.897248:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592559.897253:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788592559.897304:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897311:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592559.897345:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897369:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: 0000000072344c62/0x27b316f132510784 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251078b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592559.897395:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592559.897462:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592559.897464:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592559.897475:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592559.897493:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ad811dd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147264000:0@lo:103: 00000100:00100000:0.0:1788592559.897859:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592559.897961:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264000 00000100:00100000:1.0:1788592559.897969:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264000 00010000:00010000:1.0:1788592559.898004:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510784 expref: 12 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592559.898043:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592559.898051:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d9fda01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3283:x1875475147264000:12345-0@lo:103: 00010000:00010000:1.0:1788592559.898067:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592559.898072:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510784 expref: 12 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898086:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510784 expref: 12 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898114:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c5b6274/0x27b316f13251078b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510784 expref: 12 pid: 5817 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898131:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898139:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898166:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898173:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898179:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898186:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898191:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000019fc52a6 already unused, calling callback (00000000beb12b7b) 00010000:00010000:1.0:1788592559.898195:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898203:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898224:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592559.898237:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592559.898280:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d9fda01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3283:x1875475147264000:12345-0@lo:103: Request processed in 230us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592559.898288:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788592559.898380:0:6301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.898388:0:6301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592559.898394:0:6301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019fc52a6/0x27b316f1325107ca lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592559.899543:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ad811dd8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147264000:0@lo:103: 00010000:00010000:1.0:1788592560.383127:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592561.406874:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788592561.534501:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592561.534509:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898190067800 from 1 10000000:01000000:1.0:1788592561.534515:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592561.534575:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: 000000005c5b6274/0x27b316f1325107d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592561.534602:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: 000000005c5b6274/0x27b316f1325107d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592561.534614:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: 000000005c5b6274/0x27b316f1325107d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592561.534642:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264128:0@lo:101: 00000100:00100000:1.0:1788592561.534731:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592561.534955:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264128 00000100:00100000:0.0:1788592561.534966:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264128 00000100:00100000:0.0:1788592561.535031:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592561.535040:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001430d5af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:5820:x1875475147264128:12345-0@lo:101: 00010000:00010000:0.0:1788592561.535073:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592561.535089:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f416548f/0x27b316f1325107d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325107d1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592561.535118:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f416548f/0x27b316f1325107d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325107d1 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592561.535129:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f416548f/0x27b316f1325107d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325107d1 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592561.535139:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f416548f, rc 0) 00000100:00100000:0.0:1788592561.535179:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001430d5af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147264128:12345-0@lo:101: Request processed in 140us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592561.535186:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788592561.535498:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000004922fcd2 going to sleep for 11 seconds 00000100:00100000:1.0:1788592561.535521:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264128:0@lo:101: 00010000:00010000:1.0:1788592561.535536:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: 000000005c5b6274/0x27b316f1325107d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592561.535546:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: 000000005c5b6274/0x27b316f1325107d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592561.535606:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264256:0@lo:501: 00000100:00100000:1.0:1788592561.535634:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592561.535651:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000004922fcd2 going to sleep for 11 seconds 00000100:00100000:2.0:1788592561.536475:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264256 00000100:00100000:2.0:1788592561.536485:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264256 00000100:00100000:2.0:1788592561.536538:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592561.536547:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f1c417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147264256:12345-0@lo:501: 00000100:00100000:2.0:1788592561.537130:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f1c417 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147264256:12345-0@lo:501: Request processed in 583us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592561.537139:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592561.537231:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264256:0@lo:501: 00000100:00100000:1.0:1788592561.537344:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264384:0@lo:503: 00000100:00100000:1.0:1788592561.537417:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592561.537454:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set 000000004922fcd2 going to sleep for 11 seconds 00000100:00100000:2.0:1788592561.537505:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264384 00000100:00100000:2.0:1788592561.537511:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264384 00000100:00100000:2.0:1788592561.537581:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592561.537587:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058aa5be1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147264384:12345-0@lo:503: 00000100:00100000:2.0:1788592561.537781:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058aa5be1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147264384:12345-0@lo:503: Request processed in 194us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592561.537788:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592561.545085:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147264384:0@lo:503: 00000100:00100000:1.0:1788592561.545451:0:6363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6363:1875475147264512:0@lo:502: 00000100:00100000:1.0:1788592561.545538:0:6363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592561.547494:0:6363:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2e5d27a going to sleep for 11 seconds 00000100:00100000:0.0:1788592561.548432:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264512 00000100:00100000:0.0:1788592561.548447:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264512 00000100:00100000:0.0:1788592561.548548:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592561.548558:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058b5f948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6363:x1875475147264512:12345-0@lo:502: 00000100:00100000:0.0:1788592561.549624:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058b5f948 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6363:x1875475147264512:12345-0@lo:502: Request processed in 1064us (4083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592561.549637:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788592561.549782:0:6363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000732c1ac2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6363:1875475147264512:0@lo:502: 00000020:01000000:1.0:1788592561.550070:0:6363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592561.550082:0:6363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592561.550085:0:6363:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788592561.550092:0:6363:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff898190067800 00000020:00000080:1.0:1788592561.550095:0:6363:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592561.550155:0:6363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6363:1875475147264640:0@lo:502: 00000100:00100000:1.0:1788592561.550208:0:6363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592561.550250:0:6363:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818725d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592561.552549:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264640 00000100:00100000:0.0:1788592561.552564:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264640 00000100:00100000:0.0:1788592561.552629:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788592561.552641:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6363:x1875475147264640:12345-0@lo:502: 00000100:00100000:0.0:1788592561.553510:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6363:x1875475147264640:12345-0@lo:502: Request processed in 868us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592561.553521:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592561.553650:0:6363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6363:1875475147264640:0@lo:502: 00000020:01000000:1.0:1788592561.553686:0:6363:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592561.553694:0:6363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592561.553696:0:6363:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788592561.553701:0:6363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788592561.553968:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788592561.553986:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592561.553997:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592561.554010:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592562.430623:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592563.454632:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592564.479716:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592564.992218:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147264768:0@lo:400: 00000100:00100000:1.0:1788592564.992249:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147264896:0@lo:400: 00000100:00100000:2.0:1788592564.992534:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592564.992618:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264768 00000100:00100000:2.0:1788592564.992627:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264768 00000100:00100000:2.0:1788592564.992683:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592564.992691:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3285:x1875475147264768:12345-0@lo:400: 00000100:00100000:2.0:1788592564.992748:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3285:x1875475147264768:12345-0@lo:400: Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592564.992755:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592564.992810:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147264768:0@lo:400: 00000100:00100000:1.0:1788592564.997865:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592564.998692:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147264896 00000100:00100000:0.0:1788592564.998704:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147264896 00000100:00100000:0.0:1788592564.998779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592564.998791:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147264896:12345-0@lo:400: 00000100:00100000:0.0:1788592564.998875:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147264896:12345-0@lo:400: Request processed in 87us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592564.998884:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788592564.999076:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff898184e5b800 x1875475147264896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592564.999095:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147264896:0@lo:400: 00010000:00010000:3.0:1788592565.504688:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788592566.147796:0:6673:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592566.147802:0:6673:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788592566.147990:0:6673:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff898188438800 00000020:01000004:2.0:1788592566.148224:0:6673:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788592566.148238:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788592566.148266:0:6673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89819849cd40) 00000020:00000080:2.0:1788592566.148286:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788592566.166319:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788592566.166930:0:6673:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788592566.192247:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788592566.199805:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788592566.199845:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788592566.199901:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788592566.200221:0:6673:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788592566.200793:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788592566.200807:0:6673:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788592566.200819:0:6673:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27b316f1325107e6 00000020:01000004:1.0:1788592566.200829:0:6673:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788592566.200855:0:6673:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788592566.200859:0:6673:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788592566.200866:0:6673:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788592566.200872:0:6673:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788592566.200886:0:6673:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8981884a8000) 00000020:00000080:1.0:1788592566.200898:0:6673:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1788592566.207283:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592566.207862:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788592566.207871:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788592566.209039:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592566.209053:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788592566.209591:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592566.209600:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788592566.211991:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592566.212327:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788592566.212335:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788592566.213434:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788592566.213448:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788592566.259968:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592566.260708:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788592566.260717:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788592566.264911:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592566.264935:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788592566.266002:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788592566.266013:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788592566.270222:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592566.270945:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788592566.270953:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788592566.271769:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788592566.271787:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788592566.344187:0:6673:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592566.344483:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788592566.344491:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788592566.347474:0:6673:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788592566.347493:0:6673:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788592566.351379:0:6673:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788592566.351415:0:6673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788592566.351424:0:6673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788592566.388409:0:6673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788592566.388673:0:6673:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788592566.388679:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788592566.388682:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592566.388684:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592566.388685:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592566.388686:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592566.388687:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592566.388689:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592566.388691:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592566.388692:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592566.388695:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592566.388697:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592566.388700:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788592566.388703:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592566.388705:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592566.388706:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592566.388707:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592566.388709:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592566.388710:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592566.388712:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592566.388713:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788592566.388714:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788592566.388722:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592566.388723:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592566.388754:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788592566.388775:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147265024:0@lo:253: 00000100:00100000:2.0:1788592566.388882:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.388946:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898198936600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592566.389029:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265024 00000100:00100000:0.0:1788592566.389038:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265024 00000100:00100000:0.0:1788592566.389101:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592566.389112:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147265024:12345-0@lo:253: 20000000:01000000:0.0:1788592566.389157:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788592566.389161:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788592566.389167:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788592566.389171:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788592566.390960:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592566.391201:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788592566.391218:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788592566.391265:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788592566.391274:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788592566.391318:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788592566.391388:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788592566.391827:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788592566.392793:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:0.0:1788592566.392796:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788592566.392870:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788592566.392880:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788592566.392949:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788592566.392957:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1788592566.393005:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788592566.393015:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788592566.393044:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788592566.393094:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788592566.394250:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788592566.394278:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:0.0:1788592566.394281:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:0.0:1788592566.394316:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788592566.394324:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788592566.394601:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788592566.394611:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:0.0:1788592566.394664:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788592566.394675:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788592566.394707:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788592566.394744:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788592566.394761:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788592566.394765:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788592566.394772:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788592566.394774:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788592566.394777:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788592566.394794:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788592566.394797:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788592566.394840:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788592566.394849:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788592566.396004:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788592566.396079:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788592566.396137:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788592566.399680:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788592566.399911:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788592566.400048:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788592566.400064:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788592566.400067:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788592566.401118:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788592566.401195:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788592566.401247:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788592566.401950:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788592566.404563:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788592566.404631:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788592566.404655:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788592566.404657:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788592566.405283:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788592566.405874:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788592566.405917:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788592566.406010:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1788592566.406032:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788592566.406054:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406074:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510706 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406083:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510722 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406102:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406111:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406158:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406175:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.406191:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265152:0@lo:104: 00000100:00100000:3.0:1788592566.406271:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592566.406416:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510722 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406425:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510722 expref: 12 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.406435:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265280:0@lo:104: 00000100:00100000:3.0:1788592566.406456:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592566.406630:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510706 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.406639:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510706 expref: 12 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.406647:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265408:0@lo:104: 00000100:00100000:3.0:1788592566.406678:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.406795:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265152 00000100:00100000:2.0:1788592566.406803:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265152 00000100:00100000:2.0:1788592566.406843:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265280 00000100:00100000:2.0:1788592566.406847:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265280 00000100:00100000:2.0:1788592566.406862:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592566.406871:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147265152:12345-0@lo:104: 00010000:00010000:2.0:1788592566.406885:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.406990:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592566.406997:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147265152:12345-0@lo:104: Request processed in 127us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.407004:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592566.407025:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592566.407031:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147265280:12345-0@lo:104: 00010000:00010000:2.0:1788592566.407039:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407176:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592566.407185:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407192:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592566.407197:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407221:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592566.407229:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.407235:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592566.407275:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407282:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592566.407308:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407316:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9600/0x27b316f132510792 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510799 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407332:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592566.407336:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407341:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592566.407344:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407373:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592566.407379:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.407391:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592566.407407:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407412:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592566.407416:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407422:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762fc00/0x27b316f132510722 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510729 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407433:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592566.407434:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592566.407436:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592566.407465:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147265664:0@lo:103: 00000100:00100000:1.0:1788592566.407504:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.407536:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592566.407543:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147265536:0@lo:103: 00000100:00100000:1.0:1788592566.407564:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.407593:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265664 00000100:00100000:1.0:1788592566.407597:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265664 00010000:00010000:1.0:1788592566.407619:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510722 expref: 13 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.407744:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265536 00000100:00100000:1.0:1788592566.407748:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265536 00010000:00010000:1.0:1788592566.407763:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510792 expref: 14 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.407801:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592566.407809:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3284:x1875475147265664:12345-0@lo:103: 00010000:00010000:1.0:1788592566.407820:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592566.407826:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510722 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407837:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510722 expref: 14 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407854:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592566.407885:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3284:x1875475147265664:12345-0@lo:103: Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.407892:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592566.407911:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592566.407917:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3284:x1875475147265536:12345-0@lo:103: 00010000:00010000:1.0:1788592566.407924:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592566.407928:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510792 expref: 13 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407938:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510792 expref: 13 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.407947:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592566.407979:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3284:x1875475147265536:12345-0@lo:103: Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.407986:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592566.408023:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147265536:0@lo:103: 00000100:00100000:1.0:1788592566.408040:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147265664:0@lo:103: 00010000:00010000:2.0:1788592566.408936:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788592566.408949:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147265280:12345-0@lo:104: Request processed in 1916us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.408958:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788592566.410189:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592566.410566:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788592566.410607:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5600/0x27b316f132510799 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510792 expref: 12 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.410625:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265152:0@lo:104: 00010000:00010000:3.0:1788592566.410639:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dfc00/0x27b316f132510729 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510722 expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.410648:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265280:0@lo:104: 00000100:00100000:0.0:1788592566.411000:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265408 00000100:00100000:0.0:1788592566.411010:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265408 00000100:00100000:0.0:1788592566.411068:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592566.411078:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147265408:12345-0@lo:104: 00010000:00010000:0.0:1788592566.411097:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411201:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592566.411208:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147265408:12345-0@lo:104: Request processed in 132us (4529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592566.411215:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788592566.411252:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592566.411258:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411266:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592566.411270:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411280:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592566.411289:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592566.411295:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592566.411381:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411389:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592566.411411:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411419:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510706 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251070d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411441:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592566.411443:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592566.411444:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592566.411472:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147265792:0@lo:103: 00000100:00100000:0.0:1788592566.411510:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.411565:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265792 00000100:00100000:0.0:1788592566.411569:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265792 00010000:00010000:0.0:1788592566.411587:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510706 expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592566.411608:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592566.411615:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3285:x1875475147265792:12345-0@lo:103: 00010000:00010000:0.0:1788592566.411625:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592566.411631:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510706 expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411644:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510706 expref: 11 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411664:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411679:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411695:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411703:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411711:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411717:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411722:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592566.411727:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411735:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411745:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.411756:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592566.411783:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3285:x1875475147265792:12345-0@lo:103: Request processed in 169us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592566.411791:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592566.411822:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147265792:0@lo:103: 00010000:00010000:3.0:1788592566.412248:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dee00/0x27b316f13251070d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510706 expref: 10 pid: 5817 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.412262:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147265408:0@lo:104: 00010000:00010000:3.0:1788592566.412292:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.412302:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.412308:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.412314:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c4600/0x27b316f1325107f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788592566.412332:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788592566.480402:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:6673:x1875475147265024:12345-0@lo:253: Request processed in 91274us (91502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.480443:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592566.480668:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147265024:0@lo:253: 10000000:01000000:3.0:1788592566.480688:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788592566.480699:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592566.480702:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788592566.480703:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592566.480704:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788592566.480706:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592566.480707:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592566.480709:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592566.480711:0:6673:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788592566.480713:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592566.480714:0:6673:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788592566.480751:0:6673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff898188438800 from lustre-OST0000 10000000:01000000:3.0:1788592566.480785:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788592566.480788:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788592566.480797:0:6673:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8981884acd40 local copy 10000000:01000000:3.0:1788592566.480802:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788592566.480857:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.480872:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.480883:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.480906:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147265920:0@lo:101: 00000100:00100000:3.0:1788592566.480950:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.481087:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147265920 00000100:00100000:2.0:1788592566.481095:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147265920 00000100:00100000:2.0:1788592566.481136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592566.481146:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:6673:x1875475147265920:12345-0@lo:101: 00010000:00010000:2.0:1788592566.481159:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592566.481174:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e9c00/0x27b316f132510802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325107fb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.481199:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e9c00/0x27b316f132510802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325107fb expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.481211:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e9c00/0x27b316f132510802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325107fb expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.481220:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e9c00, rc 0) 00000100:00100000:2.0:1788592566.481250:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:6673:x1875475147265920:12345-0@lo:101: Request processed in 106us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.481257:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592566.481412:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981900893c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592566.481427:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147265920:0@lo:101: 00010000:00010000:3.0:1788592566.481443:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.481453:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.481602:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266048:0@lo:501: 00000100:00100000:3.0:1788592566.481630:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.481691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266048 00000100:00100000:2.0:1788592566.481696:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266048 00000100:00100000:2.0:1788592566.481725:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592566.481744:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:6673:x1875475147266048:12345-0@lo:501: 00000100:00100000:2.0:1788592566.482023:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:6673:x1875475147266048:12345-0@lo:501: Request processed in 291us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592566.482031:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788592566.488318:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981900893c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592566.488404:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266048:0@lo:501: 10000000:01000000:0.0:1788592566.488435:0:6673:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788592566.488505:0:6673:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788592566.488515:0:6673:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.488527:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.488534:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.488550:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788592566.488592:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff898188438800 10000000:01000000:0.0:1788592566.488598:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788592566.488603:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8981884acd40 10000000:01000000:0.0:1788592566.488605:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788592566.488609:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8981884acd40 from 1 10000000:01000000:0.0:1788592566.488612:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788592566.488649:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.488657:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.488668:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592566.488690:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266176:0@lo:101: 00000100:00100000:0.0:1788592566.488781:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592566.488880:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592566.488890:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.488900:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592566.488904:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.488913:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592566.488921:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.488927:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592566.488952:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.488959:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592566.489005:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.489014:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325107fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f132510802 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.489036:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592566.489038:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592566.489040:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592566.489098:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147266304:0@lo:103: 00000100:00100000:3.0:1788592566.489136:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.489201:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266304 00000100:00100000:1.0:1788592566.489210:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266304 00000100:00100000:1.0:1788592566.489265:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592566.489276:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:3286:x1875475147266304:12345-0@lo:103: 00010000:00010000:1.0:1788592566.489289:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592566.489304:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e9c00/0x27b316f132510802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f1325107fb expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.489322:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592566.489394:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:3286:x1875475147266304:12345-0@lo:103: Request processed in 120us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.489402:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592566.490374:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266176 00000100:00100000:2.0:1788592566.490384:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266176 00000100:00100000:2.0:1788592566.490447:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592566.490456:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:6673:x1875475147266176:12345-0@lo:101: 00010000:00010000:2.0:1788592566.490471:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592566.490488:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e9600/0x27b316f132510810 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510809 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.490512:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e9600/0x27b316f132510810 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510809 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.490523:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e9600/0x27b316f132510810 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510809 expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.490537:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e9600, rc 0) 00000100:00100000:2.0:1788592566.490603:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:6673:x1875475147266176:12345-0@lo:101: Request processed in 149us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.490610:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592566.491491:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184f9f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.491532:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266176:0@lo:101: 00010000:00010000:1.0:1788592566.491558:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.491571:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.491599:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788592566.491620:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.491629:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.491639:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788592566.491646:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592566.491664:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788592566.491667:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592566.491699:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.491707:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.491716:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.491747:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266432:0@lo:101: 00000100:00100000:1.0:1788592566.491803:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.491843:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc039300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.492054:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266432 00000100:00100000:2.0:1788592566.492062:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266432 00000100:00100000:2.0:1788592566.492112:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592566.492123:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+10:6673:x1875475147266432:12345-0@lo:101: 00010000:00010000:2.0:1788592566.492134:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592566.492147:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510817 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.492165:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510817 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.492175:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510817 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.492194:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e8000, rc 0) 00000100:00100000:2.0:1788592566.492229:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266432:12345-0@lo:101: Request processed in 108us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.492236:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592566.492413:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266432:0@lo:101: 00010000:00010000:1.0:1788592566.492425:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.492433:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.492547:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266560:0@lo:501: 00000100:00100000:1.0:1788592566.492575:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.492599:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc039300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.492615:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266560 00000100:00100000:1.0:1788592566.492619:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266560 00000100:00100000:1.0:1788592566.492640:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592566.492645:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266560:12345-0@lo:501: 00000100:00100000:1.0:1788592566.493573:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266560:12345-0@lo:501: Request processed in 921us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.493590:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592566.493713:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147266304:0@lo:103: 00000100:00100000:0.0:1788592566.493894:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266560:0@lo:501: 00000100:00100000:0.0:1788592566.493939:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266688:0@lo:503: 00000100:00100000:0.0:1788592566.493998:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.494027:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184f9fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.494168:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266688 00000100:00100000:1.0:1788592566.494177:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266688 00000100:00100000:1.0:1788592566.494224:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788592566.494234:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266688:12345-0@lo:503: 00000100:00100000:1.0:1788592566.494455:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266688:12345-0@lo:503: Request processed in 222us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.494461:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788592566.494596:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266688:0@lo:503: 00000040:00080000:0.0:1788592566.495148:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592566.495226:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266816:0@lo:502: 00000100:00100000:0.0:1788592566.495276:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.495314:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184f9fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.503076:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266816 00000100:00100000:1.0:1788592566.503100:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266816 00000100:00100000:1.0:1788592566.503176:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592566.503187:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266816:12345-0@lo:502: 00000100:00100000:1.0:1788592566.503559:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266816:12345-0@lo:502: Request processed in 373us (8281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.503567:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788592566.504962:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266816:0@lo:502: 00000040:00080000:0.0:1788592566.505377:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788592566.505452:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788592566.505490:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788592566.505557:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788592566.505597:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788592566.505633:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788592566.505687:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266944:0@lo:502: 00000100:00100000:0.0:1788592566.505958:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.506066:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184f9fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.507063:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147266944 00000100:00100000:2.0:1788592566.507075:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147266944 00000100:00100000:3.0:1788592566.507212:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592566.507223:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266944:12345-0@lo:502: 00000100:00100000:3.0:1788592566.507922:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147266944:12345-0@lo:502: Request processed in 698us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592566.507931:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788592566.508114:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147266944:0@lo:502: 00000040:00080000:2.0:1788592566.508295:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788592566.508313:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788592566.509229:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788592566.509240:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788592566.509247:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.509250:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788592566.509255:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592566.509274:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8981bf3eb380) 00000020:00000080:0.0:1788592566.509302:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788592566.509323:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788592566.509582:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount ffff898188438800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788592566.509591:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788592566.509598:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27b316f13251082c 00010000:00010000:1.0:1788592566.516287:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788592566.516710:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788592566.520027:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788592566.520458:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788592566.528730:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788592566.537108:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788592566.539149:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788592566.550221:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788592566.550239:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592566.550248:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.550250:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788592566.550254:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592566.550259:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.550261:0:6692:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788592566.550263:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788592566.550265:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788592566.550376:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592566.550381:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.550383:0:6692:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788592566.550387:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788592566.550566:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788592566.550598:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788592566.550625:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.550640:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592566.550663:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898188438800 from 1 10000000:01000000:1.0:1788592566.550666:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592566.550711:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.550720:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.550732:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.550762:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267072:0@lo:101: 00000100:00100000:1.0:1788592566.550851:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.550907:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a49780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.558307:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267072 00000100:00100000:2.0:1788592566.558331:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267072 00000100:00100000:2.0:1788592566.558421:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592566.558435:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:6673:x1875475147267072:12345-0@lo:101: 00010000:00010000:2.0:1788592566.558454:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592566.558474:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510833 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.559221:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510833 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.559237:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510833 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592566.559248:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e9800, rc 0) 00000100:00100000:2.0:1788592566.559394:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267072:12345-0@lo:101: Request processed in 963us (8543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.559401:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592566.560174:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267072:0@lo:101: 00010000:00010000:1.0:1788592566.560202:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.560215:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592566.560376:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267200:0@lo:501: 00000100:00100000:1.0:1788592566.560422:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.560464:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a49780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.561024:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267200 00000100:00100000:2.0:1788592566.561034:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267200 00000100:00100000:2.0:1788592566.561076:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592566.561085:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267200:12345-0@lo:501: 00000100:00100000:2.0:1788592566.561532:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267200:12345-0@lo:501: Request processed in 445us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.561541:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788592566.566070:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267200:0@lo:501: 00000100:00100000:0.0:1788592566.566150:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267328:0@lo:503: 00000100:00100000:0.0:1788592566.566241:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.566299:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819062d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.566424:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267328 00000100:00100000:2.0:1788592566.566433:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267328 00000100:00100000:2.0:1788592566.566508:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788592566.566520:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267328:12345-0@lo:503: 00000100:00100000:2.0:1788592566.568562:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267328:12345-0@lo:503: Request processed in 2036us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.570286:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592566.570891:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267328:0@lo:503: 00000040:00080000:1.0:1788592566.571319:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592566.571463:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267456:0@lo:502: 00000100:00100000:1.0:1788592566.571553:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592566.571612:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592566.571784:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267456 00000100:00100000:3.0:1788592566.571793:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267456 00000100:00100000:3.0:1788592566.571859:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592566.571870:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267456:12345-0@lo:502: 00000100:00100000:3.0:1788592566.572160:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267456:12345-0@lo:502: Request processed in 292us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592566.572169:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788592566.572248:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267456:0@lo:502: 00000040:00080000:2.0:1788592566.572937:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788592566.573020:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788592566.573058:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267584:0@lo:502: 00000100:00100000:2.0:1788592566.573112:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.574066:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592566.575141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267584 00000100:00100000:3.0:1788592566.575154:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267584 00000100:00100000:2.0:1788592566.575300:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788592566.575312:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267584:12345-0@lo:502: 00000100:00100000:2.0:1788592566.579484:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267584:12345-0@lo:502: Request processed in 4159us (6357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.579503:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592566.579555:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267584:0@lo:502: 00000040:00080000:3.0:1788592566.579819:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788592566.579840:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788592566.582520:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592566.582540:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.582543:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592566.582552:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff898188438800 00000020:00000080:0.0:1788592566.582556:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592566.582579:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592566.582582:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592566.582584:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788592566.582600:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788592566.582793:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788592566.582820:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592566.582976:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.582999:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592566.583050:0:6673:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788592566.583054:0:6673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff898188438800 10000000:01000000:3.0:1788592566.583057:0:6673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff898188438800 10000000:01000000:3.0:1788592566.583061:0:6673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592566.583068:0:6673:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898188438800 from 1 10000000:01000000:3.0:1788592566.583071:0:6673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592566.583118:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.583126:0:6673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.583137:0:6673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.583166:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267712:0@lo:101: 00000100:00100000:3.0:1788592566.583250:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592566.583325:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.583416:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267712 00000100:00100000:1.0:1788592566.583425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267712 00000100:00100000:1.0:1788592566.583476:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592566.583487:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147267712:12345-0@lo:101: 00010000:00010000:1.0:1788592566.583502:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592566.583516:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510841 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.583541:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510841 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.583552:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510841 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592566.583562:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813df800, rc 0) 00000100:00100000:1.0:1788592566.583618:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147267712:12345-0@lo:101: Request processed in 133us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.583624:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592566.583775:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267712:0@lo:101: 00010000:00010000:3.0:1788592566.583792:0:6673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592566.583802:0:6673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.583939:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267840:0@lo:501: 00000100:00100000:3.0:1788592566.583978:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592566.584004:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.584094:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267840 00000100:00100000:2.0:1788592566.584100:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267840 00000100:00100000:2.0:1788592566.584139:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788592566.584146:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147267840:12345-0@lo:501: 00000100:00100000:2.0:1788592566.584452:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147267840:12345-0@lo:501: Request processed in 304us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.584460:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592566.587766:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267840:0@lo:501: 00000100:00100000:3.0:1788592566.587866:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267968:0@lo:503: 00000100:00100000:3.0:1788592566.587989:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592566.588045:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.588105:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147267968 00000100:00100000:1.0:1788592566.588114:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147267968 00000100:00100000:1.0:1788592566.588177:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788592566.588188:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147267968:12345-0@lo:503: 00000100:00100000:1.0:1788592566.588448:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147267968:12345-0@lo:503: Request processed in 261us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.588456:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788592566.588636:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147267968:0@lo:503: 00000040:00080000:3.0:1788592566.589064:0:6673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592566.589159:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268096:0@lo:502: 00000100:00100000:3.0:1788592566.589205:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592566.589238:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592566.589384:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268096 00000100:00100000:1.0:1788592566.589397:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268096 00000100:00100000:1.0:1788592566.589435:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788592566.589443:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147268096:12345-0@lo:502: 00000100:00100000:1.0:1788592566.589634:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147268096:12345-0@lo:502: Request processed in 192us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592566.589642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592566.589750:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268096:0@lo:502: 00000040:00080000:3.0:1788592566.590050:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788592566.590103:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788592566.590139:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788592566.590185:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788592566.590220:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788592566.590262:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788592566.590296:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788592566.590327:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788592566.590398:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788592566.590435:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788592566.590464:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788592566.590508:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788592566.590559:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788592566.590603:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788592566.590649:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788592566.590685:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788592566.590717:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788592566.590777:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788592566.590813:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788592566.590846:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788592566.590890:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788592566.590925:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788592566.590958:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788592566.595512:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788592566.595580:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788592566.595616:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788592566.595671:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788592566.595945:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788592566.596017:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268224:0@lo:502: 00000100:00100000:3.0:1788592566.596130:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592566.597307:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592566.597542:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268224 00000100:00100000:2.0:1788592566.597553:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268224 00000100:00100000:2.0:1788592566.597655:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788592566.597667:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147268224:12345-0@lo:502: 00000100:00100000:2.0:1788592566.597994:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147268224:12345-0@lo:502: Request processed in 329us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.598003:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592566.598105:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268224:0@lo:502: 00000040:00080000:3.0:1788592566.598252:0:6673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788592566.598271:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788592566.598949:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788592566.598982:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89818738cd40) 00000020:00000080:3.0:1788592566.599024:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788592566.599100:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff898188438800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592566.599106:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff898188438800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592566.599109:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898188438800 3 00010000:00080000:3.0:1788592566.599139:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898084aca000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1788592566.600795:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788592566.601036:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788592566.601085:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592566.601100:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27b316f132510856 00000100:00080000:3.0:1788592566.601114:0:6697:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592566.601121:0:6697:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff898084aca000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592566.601167:0:6697:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898183e98000 x1875475147268352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592566.601205:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788592566.601300:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147268480:0@lo:400: 00000100:00100000:3.0:1788592566.601414:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.603606:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147268352:0@lo:38: 00000100:00100000:2.0:1788592566.603695:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592566.603773:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268480 00000100:00100000:2.0:1788592566.603783:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268480 00000100:00100000:2.0:1788592566.603827:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268352 00000100:00100000:2.0:1788592566.603830:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268352 00000100:00100000:2.0:1788592566.603843:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592566.603852:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147268480:12345-0@lo:400: 00000100:00100000:1.0:1788592566.604430:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788592566.604444:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788592566.604572:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147268480:12345-0@lo:400: Request processed in 718us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.604580:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592566.604607:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592566.604612:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147268352:12345-0@lo:38: 00010000:00080000:2.0:1788592566.604641:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:2.0:1788592566.604683:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27b316f13251085d 00000004:00100000:2.0:1788592566.604712:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592566.604751:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8981904a1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592566.604811:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875475147268352:12345-0@lo:38: Request processed in 197us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592566.604818:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788592566.604870:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e9bb80 x1875475147268480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592566.604887:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147268480:0@lo:400: 00010000:00080000:1.0:1788592566.605415:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e98000 x1875475147268352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592566.605424:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592566.605431:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788592566.605439:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788592566.605444:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788592566.605446:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084aca000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788592566.605452:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147268352:0@lo:38: 00000040:00080000:3.0:1788592566.606522:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788592566.606709:0:6673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788592566.606737:0:6673:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592566.606762:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.606774:0:6673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592566.606827:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592566.606829:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592566.606831:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592566.606832:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592566.606833:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592566.606834:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592566.606836:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592566.606837:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592566.606839:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592566.606841:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592566.606842:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592566.606861:0:6673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788592566.606864:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592566.606865:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592566.606866:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592566.606867:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592566.606868:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592566.606869:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592566.606870:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592566.606871:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592566.606872:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592566.606873:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592566.606874:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592566.606901:0:6673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788592566.606922:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268608:0@lo:253: 00000100:00100000:0.0:1788592566.607014:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.607050:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819062d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592566.607309:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268608 00000100:00100000:3.0:1788592566.607317:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268608 00000100:00100000:3.0:1788592566.607383:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788592566.607394:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6673:x1875475147268608:12345-0@lo:253: 20000000:01000000:3.0:1788592566.607422:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788592566.607437:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788592566.670424:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788592566.670446:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788592566.670474:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788592566.670479:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788592566.670506:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.670526:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325107bc expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.670535:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.670587:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.670604:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 13 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592566.670619:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147268736:0@lo:104: 00000100:00100000:0.0:1788592566.670701:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.670766:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff898189768f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592566.670792:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268736 00000100:00100000:0.0:1788592566.670799:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268736 00000100:00100000:0.0:1788592566.670848:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592566.670857:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147268736:12345-0@lo:104: 00010000:00010000:0.0:1788592566.670870:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.670931:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592566.670939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147268736:12345-0@lo:104: Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592566.670972:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788592566.670999:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592566.671006:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671012:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592566.671016:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671025:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592566.671031:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592566.671037:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592566.671145:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671153:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592566.671175:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671182:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c5800/0x27b316f1325107bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107c3 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671202:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592566.671204:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592566.671206:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592566.671226:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147268864:0@lo:103: 00000100:00100000:0.0:1788592566.671266:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592566.671301:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268864 00000100:00100000:0.0:1788592566.671305:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268864 00010000:00010000:0.0:1788592566.671322:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 14 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592566.671345:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592566.671395:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3284:x1875475147268864:12345-0@lo:103: 00010000:00010000:0.0:1788592566.671405:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592566.671411:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 14 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671421:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 14 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671438:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671446:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592566.671460:0:5810:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001650341s 00010000:00010000:0.0:1788592566.671465:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671472:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671479:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671496:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671501:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592566.671505:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671512:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671519:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671528:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592566.671557:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3284:x1875475147268864:12345-0@lo:103: Request processed in 207us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592566.671564:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592566.671641:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147268864:0@lo:103: 00010000:00010000:0.0:1788592566.671670:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762ec00/0x27b316f1325107c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f1325107bc expref: 13 pid: 5815 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592566.671682:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147268736:0@lo:104: 00010000:00010000:0.0:1788592566.671693:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671702:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671708:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592566.671722:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e400/0x27b316f132510864 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592566.696843:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:6673:x1875475147268608:12345-0@lo:253: Request processed in 89435us (89813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592566.696862:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592566.696974:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:6673:1875475147268608:0@lo:253: 10000000:01000000:0.0:1788592566.696993:0:6673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788592566.696997:0:6673:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592566.696999:0:6673:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592566.697000:0:6673:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592566.697001:0:6673:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592566.697002:0:6673:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592566.697003:0:6673:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592566.697005:0:6673:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592566.697006:0:6673:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788592566.697008:0:6673:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788592566.697010:0:6673:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592566.697011:0:6673:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788592566.697028:0:6673:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788592566.703687:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788592566.704136:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788592566.704779:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788592566.704997:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788592566.705334:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788592566.705799:0:6673:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788592566.707418:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788592566.915951:0:6673:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788592566.915971:0:6673:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788592566.916015:0:6673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592566.916088:0:6673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592566.916108:0:6673:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788592566.916145:0:6673:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788592567.551859:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592568.580062:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592569.599231:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788592569.790454:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592569.790465:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898190067800 from 21 10000000:01000000:0.0:1788592569.790471:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592569.790533:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.790546:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.790568:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592569.790599:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147268992:0@lo:101: 00000100:00100000:0.0:1788592569.790721:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592569.790791:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819062d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.791822:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147268992 00000100:00100000:3.0:1788592569.791837:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147268992 00000100:00100000:3.0:1788592569.791975:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788592569.791986:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147268992:12345-0@lo:101: 00010000:00010000:3.0:1788592569.792002:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592569.792020:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f13251086b expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.792050:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f13251086b expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.792073:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251086b expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.792084:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5800, rc 0) 00000100:00100000:3.0:1788592569.792205:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147268992:12345-0@lo:101: Request processed in 220us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.792211:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788592569.792314:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147268992:0@lo:101: 00010000:00010000:1.0:1788592569.792337:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.792691:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.792775:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba577800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269120:0@lo:501: 00000100:00100000:1.0:1788592569.792813:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.792857:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.793322:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269120 00000100:00100000:3.0:1788592569.793330:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269120 00000100:00100000:3.0:1788592569.793472:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788592569.793482:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147269120:12345-0@lo:501: 00000100:00100000:3.0:1788592569.793985:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147269120:12345-0@lo:501: Request processed in 502us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.793995:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592569.794503:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba577800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269120:0@lo:501: 00000100:00100000:0.0:1788592569.794568:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269248:0@lo:503: 00000100:00100000:0.0:1788592569.794632:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592569.794707:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819062d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.794776:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269248 00000100:00100000:3.0:1788592569.794782:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269248 00000100:00100000:3.0:1788592569.794850:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592569.794861:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147269248:12345-0@lo:503: 00000100:00100000:3.0:1788592569.795494:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147269248:12345-0@lo:503: Request processed in 633us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.795503:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592569.795574:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269248:0@lo:503: 00000100:00100000:0.0:1788592569.796073:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6831:1875475147269376:0@lo:502: 00000100:00100000:0.0:1788592569.796124:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592569.796163:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197713780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.796212:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269376 00000100:00100000:3.0:1788592569.796218:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269376 00000100:00100000:3.0:1788592569.796274:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788592569.796281:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6831:x1875475147269376:12345-0@lo:502: 00000100:00100000:3.0:1788592569.796633:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6831:x1875475147269376:12345-0@lo:502: Request processed in 350us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.796648:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592569.796730:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6831:1875475147269376:0@lo:502: 00000100:00100000:0.0:1788592569.796781:0:6831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6831:1875475147269504:0@lo:502: 00000100:00100000:0.0:1788592569.796816:0:6831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592569.796857:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269504 00000100:00100000:3.0:1788592569.796861:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269504 00000100:00100000:0.0:1788592569.796866:0:6831:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197713780 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.796968:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592569.796976:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6831:x1875475147269504:12345-0@lo:502: 00000100:00100000:3.0:1788592569.797202:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:6831:x1875475147269504:12345-0@lo:502: Request processed in 226us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.797209:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592569.797285:0:6831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6831:1875475147269504:0@lo:502: 00000040:00080000:0.0:1788592569.797308:0:6831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788592569.797936:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788592569.797957:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592569.797970:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.797982:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592569.797993:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788592569.797996:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff898190067800 from 4 10000000:01000000:1.0:1788592569.798000:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788592569.798049:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.798059:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.798070:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.798092:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269632:0@lo:101: 00000100:00100000:1.0:1788592569.798148:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.798191:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592569.798307:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269632 00000100:00100000:3.0:1788592569.798315:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269632 00000100:00100000:3.0:1788592569.798426:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592569.798436:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147269632:12345-0@lo:101: 00010000:00010000:3.0:1788592569.798447:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592569.798463:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510879 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.798486:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510879 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.798497:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510879 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592569.798837:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592569.798893:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147269632:12345-0@lo:101: Request processed in 459us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592569.798900:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788592569.798986:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269632:0@lo:101: 00010000:00010000:1.0:1788592569.799004:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.799015:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.799088:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269760:0@lo:256: 00000100:00100000:1.0:1788592569.799123:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.799300:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.799441:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269760 00000100:00100000:0.0:1788592569.799449:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269760 00000100:00100000:0.0:1788592569.799481:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592569.799488:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147269760:12345-0@lo:256: 20000000:01000000:0.0:1788592569.799524:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592569.799553:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592569.799557:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788592569.799807:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147269760:12345-0@lo:256: Request processed in 317us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.799815:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788592569.799923:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269760:0@lo:256: 10000000:01000000:1.0:1788592569.799976:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788592569.799986:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.799995:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592569.800005:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788592569.800008:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788592569.800011:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592569.800035:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.800042:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.800062:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.800076:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269888:0@lo:101: 00000100:00100000:1.0:1788592569.800103:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.800133:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.800287:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147269888 00000100:00100000:0.0:1788592569.800293:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147269888 00000100:00100000:0.0:1788592569.800317:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788592569.800323:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147269888:12345-0@lo:101: 00010000:00010000:0.0:1788592569.800332:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592569.800345:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510887 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.800398:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510887 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.800409:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510887 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.800417:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fe00, rc 0) 00000100:00100000:0.0:1788592569.800445:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147269888:12345-0@lo:101: Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.800451:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592569.800536:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147269888:0@lo:101: 00010000:00010000:1.0:1788592569.800549:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.800558:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.800619:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270016:0@lo:501: 00000100:00100000:1.0:1788592569.800647:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.800674:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.801048:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270016 00000100:00100000:0.0:1788592569.801054:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270016 00000100:00100000:0.0:1788592569.801074:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788592569.801080:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147270016:12345-0@lo:501: 00000100:00100000:0.0:1788592569.801432:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147270016:12345-0@lo:501: Request processed in 350us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.801450:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592569.811482:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270016:0@lo:501: 00000100:00100000:1.0:1788592569.811649:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270144:0@lo:503: 00000100:00100000:1.0:1788592569.811835:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.811913:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.811944:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270144 00000100:00100000:0.0:1788592569.811952:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270144 00000100:00100000:0.0:1788592569.812024:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592569.812035:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147270144:12345-0@lo:503: 00000100:00100000:0.0:1788592569.812522:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147270144:12345-0@lo:503: Request processed in 487us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.812530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592569.812763:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270144:0@lo:503: 00000100:00100000:1.0:1788592569.813793:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6832:1875475147270272:0@lo:502: 00000100:00100000:1.0:1788592569.813865:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.813933:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592569.814280:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270272 00000100:00100000:2.0:1788592569.814289:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270272 00000100:00100000:2.0:1788592569.814343:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788592569.814383:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:6832:x1875475147270272:12345-0@lo:502: 00000100:00100000:2.0:1788592569.815615:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:6832:x1875475147270272:12345-0@lo:502: Request processed in 1227us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592569.815628:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592569.815788:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6832:1875475147270272:0@lo:502: 00000020:01000000:1.0:1788592569.815846:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788592569.815857:0:6832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788592569.815865:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592569.815867:0:6832:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788592569.815873:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788592569.815888:0:6832:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1788592569.815924:0:6832:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788592569.815927:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592569.816240:0:6832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8981884a99c0) 00000020:00000080:1.0:1788592569.816268:0:6832:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788592569.816275:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592569.816669:0:6832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788592569.816676:0:6832:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788592569.816753:0:6832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f13251089c 00010000:00080000:2.0:1788592569.816789:0:6832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8981c0d88800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1788592569.817241:0:6832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788592569.902963:0:6832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788592569.903000:0:6832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788592569.907300:0:6832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592569.909144:0:6832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592569.909219:0:6832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788592569.909300:0:6832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788592569.910239:0:6838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592569.910247:0:6838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788592569.911282:0:6832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592569.911301:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788592569.911377:0:6832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788592569.911405:0:6832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f1325108a3 00000100:00080000:0.0:1788592569.911419:0:6832:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592569.911426:0:6832:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8981c0d88800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592569.911471:0:6832:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898184e5b100 x1875475147270400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788592569.911494:0:6832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788592569.911577:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592569.911582:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788592569.911703:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147270400:0@lo:8: 00000100:00100000:1.0:1788592569.911823:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.911935:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270400 00000100:00100000:1.0:1788592569.911944:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270400 00000100:00100000:1.0:1788592569.911986:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592569.911994:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147270400:12345-0@lo:8: 00010000:00080000:1.0:1788592569.912021:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:1.0:1788592569.912065:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f1325108aa 00002000:00100000:1.0:1788592569.912109:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff898184fc9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788592569.912115:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788592569.912126:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788592569.912279:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788592569.912476:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788592569.912503:0:6676:0:(import.c:65:import_set_state_nolock()) ffff898184fce000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592569.912844:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875475147270400:12345-0@lo:8: Request processed in 847us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592569.912853:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788592569.912912:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898184e5b100 x1875475147270400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592569.912925:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592569.912934:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788592569.912943:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788592569.912948:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788592569.912951:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8981c0d88800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788592569.912960:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788592569.912966:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147270400:0@lo:8: 00000004:00080000:1.0:1788592569.912995:0:6838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788592569.913116:0:6838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 144153764972ns, next at 0ns, rc = 0 00000020:00000080:0.0:1788592569.913457:0:6832:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788592569.913471:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592569.913481:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592569.913483:0:6832:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788592569.913487:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788592569.913490:0:6832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788592569.913541:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6832:1875475147270528:0@lo:502: 00000100:00100000:0.0:1788592569.913721:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592569.913844:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197713180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592569.913931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270528 00000100:00100000:1.0:1788592569.913939:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270528 00000100:00100000:1.0:1788592569.913988:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592569.913998:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:6832:x1875475147270528:12345-0@lo:502: 00000100:00100000:1.0:1788592569.914241:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:6832:x1875475147270528:12345-0@lo:502: Request processed in 243us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592569.914248:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788592569.914386:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:6832:1875475147270528:0@lo:502: 00000020:01000000:0.0:1788592569.914416:0:6832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592569.914422:0:6832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592569.914424:0:6832:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788592569.914428:0:6832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788592569.914829:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788592569.914848:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788592569.914858:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.914879:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592569.914891:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788592569.914894:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8981884acd40 from 1 10000000:01000000:1.0:1788592569.914897:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788592569.914942:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.914951:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.914959:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592569.914975:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270656:0@lo:101: 00000100:00100000:1.0:1788592569.915016:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.915049:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.915099:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270656 00000100:00100000:0.0:1788592569.915105:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270656 00000100:00100000:0.0:1788592569.915143:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788592569.915150:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147270656:12345-0@lo:101: 00010000:00010000:0.0:1788592569.915161:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592569.915175:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325108b1 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.915199:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.915215:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.915224:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fa00, rc 0) 00000100:00100000:0.0:1788592569.915258:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147270656:12345-0@lo:101: Request processed in 108us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.915265:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788592569.915303:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270656:0@lo:101: 00010000:00010000:0.0:1788592569.915319:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592569.915328:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592569.915415:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270784:0@lo:501: 00000100:00100000:0.0:1788592569.915441:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592569.915455:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197713cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592569.915470:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270784 00000100:00100000:0.0:1788592569.915473:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270784 00000100:00100000:0.0:1788592569.915493:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592569.915827:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147270784:12345-0@lo:501: 00000100:00100000:0.0:1788592569.916141:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147270784:12345-0@lo:501: Request processed in 639us (696us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592569.916150:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788592569.916267:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147271040:0@lo:400: 00000100:00100000:3.0:1788592569.916319:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592569.916454:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592569.916461:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147270912:0@lo:400: 00000100:00100000:3.0:1788592569.916485:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592569.916941:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147270784:0@lo:501: 10000000:01000000:1.0:1788592569.916979:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788592569.916987:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592569.916996:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592569.918458:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271040 00000100:00100000:0.0:1788592569.918473:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271040 00000100:00080000:1.0:1788592569.918840:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592569.918882:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147270912 00000100:00100000:0.0:1788592569.918888:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147270912 00000100:00100000:0.0:1788592569.919015:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592569.919028:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147271040:12345-0@lo:400: 00000100:00100000:0.0:1788592569.919131:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147271040:12345-0@lo:400: Request processed in 106us (2811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.919139:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592569.919155:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592569.919161:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147270912:12345-0@lo:400: 00000100:00100000:0.0:1788592569.919188:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147270912:12345-0@lo:400: Request processed in 27us (2702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592569.919194:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788592569.931289:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e99180 x1875475147270912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592569.931317:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147270912:0@lo:400: 00010000:00080000:3.0:1788592569.931334:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e99f80 x1875475147271040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592569.931342:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147271040:0@lo:400: 00000004:00080000:2.0:1788592570.014777:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788592570.093553:0:6839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788592570.093610:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271296:0@lo:7: 00000100:00100000:2.0:1788592570.093725:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592570.093787:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592570.094115:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592570.094130:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147271168:0@lo:13: 00000100:00100000:0.0:1788592570.094187:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592570.094228:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271296 00000100:00100000:0.0:1788592570.094238:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271296 00000100:00100000:0.0:1788592570.094299:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592570.094309:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6839:x1875475147271296:12345-0@lo:7: 00000100:00080000:1.0:1788592570.097955:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592570.098778:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271168 00000100:00100000:2.0:1788592570.098795:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271168 00000100:00100000:2.0:1788592570.098878:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592570.098890:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147271168:12345-0@lo:13: 00002000:00000024:2.0:1788592570.098942:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788592570.099056:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147271168:12345-0@lo:13: Request processed in 168us (4868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592570.099064:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788592570.099310:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e6680 x1875475147271168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592586 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592570.099340:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147271168:0@lo:13: 00002000:00080000:1.0:1788592570.109935:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788592570.109947:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788592570.110076:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6839:x1875475147271296:12345-0@lo:7: Request processed in 15763us (16346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592570.110091:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592570.110336:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e6a00 x1875475147271296/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592570.110383:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271296:0@lo:7: 00000004:00080000:2.0:1788592570.110404:0:6839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788592570.110454:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271424:0@lo:5: 00000100:00100000:2.0:1788592570.110496:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592570.110546:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592570.111014:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271424 00000100:00100000:1.0:1788592570.111026:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271424 00000100:00100000:1.0:1788592570.111134:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592570.111146:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6839:x1875475147271424:12345-0@lo:5: 00002000:00080000:1.0:1788592570.111200:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788592570.111206:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788592570.111888:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6839:x1875475147271424:12345-0@lo:5: Request processed in 742us (1389us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788592570.111908:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788592570.111997:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e6a00 x1875475147271424/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592570.112025:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271424:0@lo:5: 00000004:00080000:3.0:1788592570.112040:0:6839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788592570.112076:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271552:0@lo:700: 00000100:00100000:3.0:1788592570.112118:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592570.112141:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184b600c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592570.112178:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271552 00000100:00100000:3.0:1788592570.112184:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271552 00000100:00100000:3.0:1788592570.112236:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592570.112244:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6839:x1875475147271552:12345-0@lo:700: 00000100:00100000:3.0:1788592570.112278:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e98380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875475147271680:0@lo:700: 00000100:00100000:3.0:1788592570.112309:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592570.112337:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184b60840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592570.112577:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271680 00000100:00100000:3.0:1788592570.112583:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271680 00000100:00100000:3.0:1788592570.112613:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592570.113050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875475147271680:12345-0@lo:700: 40000000:02000000:3.0:1788592570.219939:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788592570.226254:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6684:x1875475147271680:12345-0@lo:700: Request processed in 113617us (113926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592570.226275:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788592570.226858:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e98380 x1875475147271680/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788592586 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592570.226883:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e98380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6684:1875475147271680:0@lo:700: 40000000:02000000:1.0:1788592570.226914:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788592570.349773:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788592570.349801:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788592570.353291:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6839:x1875475147271552:12345-0@lo:700: Request processed in 241032us (241156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592570.353317:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788592570.358693:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898183e99f80 x1875475147271552/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592570.358715:0:6839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788592570.358922:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271552:0@lo:700: 00000004:02000040:1.0:1788592570.449046:0:6839:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788592570.458887:0:6839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271808:0@lo:5: 00000100:00100000:0.0:1788592570.458999:0:6839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592570.459067:0:6839:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185b83b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592570.459176:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271808 00000100:00100000:1.0:1788592570.459187:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271808 00000100:00100000:1.0:1788592570.459259:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592570.459270:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6839:x1875475147271808:12345-0@lo:5: 00002000:00080000:0.0:1788592570.466494:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788592570.466522:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788592570.476865:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6839:x1875475147271808:12345-0@lo:5: Request processed in 17585us (17854us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788592570.476884:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788592570.476996:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898184e59880 x1875475147271808/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592586 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592570.477021:0:6839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1875475147271808:0@lo:5: 00000004:00080000:1.0:1788592570.477043:0:6839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788592570.623195:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592571.646683:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592572.670796:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592573.694963:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592574.056314:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788592574.720453:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592575.230830:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592575.230867:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147271936:0@lo:13: 00000100:00100000:3.0:1788592575.230975:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592575.231075:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147271936 00000100:00100000:1.0:1788592575.231086:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147271936 00000100:00080000:3.0:1788592575.231161:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592575.231163:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592575.231175:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147271936:12345-0@lo:13: 00002000:00000024:1.0:1788592575.231220:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788592575.231418:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981ba577b80 x1875475147271936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592591 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592575.231440:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147271936:0@lo:13: 00000100:00100000:0.0:1788592575.231566:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592575.231577:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147272320:0@lo:400: 00000100:00100000:0.0:1788592575.231617:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592575.231645:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147271936:12345-0@lo:13: Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592575.231657:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592575.231699:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272320 00000100:00100000:1.0:1788592575.231704:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272320 00000100:00100000:1.0:1788592575.231754:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592575.231758:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147272064:0@lo:400: 00000100:00100000:1.0:1788592575.231766:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147272320:12345-0@lo:400: 00000100:00100000:3.0:1788592575.231812:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592575.231867:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592575.234449:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272064 00000100:00100000:0.0:1788592575.234468:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272064 00000100:00100000:0.0:1788592575.234542:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788592575.234553:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3285:x1875475147272064:12345-0@lo:400: 00000100:00100000:3.0:1788592575.234923:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592575.234938:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147272192:0@lo:400: 00000100:00100000:3.0:1788592575.235008:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592575.235059:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272192 00000100:00100000:3.0:1788592575.235064:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272192 00000100:00100000:3.0:1788592575.235096:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592575.235103:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147272192:12345-0@lo:400: 00000100:00100000:3.0:1788592575.235147:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147272192:12345-0@lo:400: Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592575.235167:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788592575.235216:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898184e5b800 x1875475147272192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592575.235234:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147272192:0@lo:400: 00000100:00100000:1.0:1788592575.237583:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147272320:12345-0@lo:400: Request processed in 5806us (5950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592575.237600:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788592575.237694:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898184e59500 x1875475147272320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592575.237713:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147272320:0@lo:400: 00000100:00100000:0.0:1788592575.237958:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3285:x1875475147272064:12345-0@lo:400: Request processed in 3405us (6154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592575.237968:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788592575.238108:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147272064:0@lo:400: 00010000:00010000:1.0:1788592575.746562:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788592575.844621:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788592576.767486:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592577.790636:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592578.814650:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592579.839816:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592580.356372:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147272576:0@lo:400: 00000100:00100000:2.0:1788592580.356464:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592580.356534:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592580.356541:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147272704:0@lo:400: 00000100:00100000:2.0:1788592580.356720:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592580.356851:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147272448:0@lo:400: 00000100:00100000:1.0:1788592580.356891:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592580.356930:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592580.356936:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147272832:0@lo:400: 00000100:00100000:1.0:1788592580.356964:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592580.356998:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272832 00000100:00100000:1.0:1788592580.357006:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272832 00000100:00100000:1.0:1788592580.357072:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592580.357082:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147272832:12345-0@lo:400: 00000100:00100000:1.0:1788592580.357140:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147272832:12345-0@lo:400: Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592580.357147:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788592580.357179:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788592580.357212:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e7800 x1875475147272832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592580.357224:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788592580.357242:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147272832:0@lo:400: 00000100:00100000:1.0:1788592580.357698:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147272960:0@lo:13: 00000100:00100000:1.0:1788592580.357743:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592580.357777:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272960 00000100:00100000:1.0:1788592580.357781:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272960 00000100:00100000:1.0:1788592580.357811:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592580.357818:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147272960:12345-0@lo:13: 00002000:00000024:1.0:1788592580.357851:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592580.357890:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147272960:12345-0@lo:13: Request processed in 73us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592580.357910:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788592580.357943:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981ba575180 x1875475147272960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592596 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592580.357960:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147272960:0@lo:13: 00000100:00100000:2.0:1788592580.366063:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272448 00000100:00100000:2.0:1788592580.366086:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272448 00000100:00100000:2.0:1788592580.366171:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592580.366183:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3284:x1875475147272448:12345-0@lo:400: 00000100:00100000:2.0:1788592580.366314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3284:x1875475147272448:12345-0@lo:400: Request processed in 134us (9422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592580.366332:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592580.366458:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272576 00000100:00100000:2.0:1788592580.366464:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272576 00000100:00100000:2.0:1788592580.366491:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147272704 00000100:00100000:2.0:1788592580.366495:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147272704 00000100:00100000:2.0:1788592580.366535:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592580.366542:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147272576:12345-0@lo:400: 00000100:00100000:2.0:1788592580.366599:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147272576:12345-0@lo:400: Request processed in 58us (10135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592580.366606:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592580.366620:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592580.366626:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147272704:12345-0@lo:400: 00000100:00100000:2.0:1788592580.366655:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147272704:12345-0@lo:400: Request processed in 30us (9936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592580.366662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788592580.366721:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e4a80 x1875475147272704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592580.366739:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147272704:0@lo:400: 00010000:00080000:2.0:1788592580.366755:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e5500 x1875475147272576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592580.366764:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147272576:0@lo:400: 00000100:00100000:1.0:1788592580.367117:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147272448:0@lo:400: 00000100:00080000:1.0:1788592580.367144:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592580.864422:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592581.894571:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592582.912427:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592583.949578:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592584.960342:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592585.472806:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147273216:0@lo:400: 00000100:00100000:2.0:1788592585.472889:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.472973:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592585.472979:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147273088:0@lo:400: 00000100:00100000:2.0:1788592585.473013:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.473050:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147273344:0@lo:400: 00000100:00100000:2.0:1788592585.473078:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.473100:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592585.473105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147273472:0@lo:400: 00000100:00100000:2.0:1788592585.473135:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.473172:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273216 00000100:00100000:2.0:1788592585.473182:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273216 00000100:00100000:2.0:1788592585.473376:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273344 00000100:00100000:2.0:1788592585.473381:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273344 00000100:00100000:2.0:1788592585.473420:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592585.473429:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147273216:12345-0@lo:400: 00000100:00100000:2.0:1788592585.473488:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147273216:12345-0@lo:400: Request processed in 59us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.473497:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592585.473515:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592585.473521:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147273344:12345-0@lo:400: 00000100:00100000:2.0:1788592585.473550:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147273344:12345-0@lo:400: Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.473556:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592585.473574:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273088 00000100:00100000:2.0:1788592585.473578:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273088 00000100:00100000:2.0:1788592585.473602:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592585.473623:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3286:x1875475147273088:12345-0@lo:400: 00000100:00100000:2.0:1788592585.473658:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3286:x1875475147273088:12345-0@lo:400: Request processed in 36us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.473673:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592585.473716:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273472 00000100:00100000:2.0:1788592585.473720:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273472 00000100:00100000:2.0:1788592585.473799:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592585.473808:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147273472:12345-0@lo:400: 00000100:00100000:2.0:1788592585.473842:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147273472:12345-0@lo:400: Request processed in 37us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.473848:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592585.478774:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147273600:0@lo:13: 00000100:00100000:3.0:1788592585.478884:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788592585.479034:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592585.479053:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592585.479115:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e6300 x1875475147273472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592585.479131:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147273472:0@lo:400: 00010000:00080000:2.0:1788592585.479147:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e7b80 x1875475147273344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592585.479155:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147273344:0@lo:400: 00000100:00100000:2.0:1788592585.479197:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147273088:0@lo:400: 00010000:00080000:2.0:1788592585.479429:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc1e4a80 x1875475147273216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592585.479439:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147273216:0@lo:400: 00000100:00100000:0.0:1788592585.480222:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273600 00000100:00100000:0.0:1788592585.480231:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273600 00000100:00100000:0.0:1788592585.480303:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592585.480314:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147273600:12345-0@lo:13: 00002000:00000024:0.0:1788592585.480380:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592585.480454:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147273600:12345-0@lo:13: Request processed in 141us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.480462:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788592585.480715:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981ba575180 x1875475147273600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592601 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592585.480734:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147273600:0@lo:13: 00000020:01000004:3.0:1788592585.767691:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788592585.767695:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788592585.767871:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89819840e800 00000020:01000004:3.0:1788592585.767890:0:7614:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788592585.767904:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788592585.767922:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff898187388000) 00000020:00000080:3.0:1788592585.767941:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788592585.784990:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788592585.785496:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788592585.821050:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788592585.831054:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788592585.831094:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788592585.831154:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788592585.831183:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788592585.831833:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788592585.831846:0:7614:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788592585.831865:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27b316f1325108c6 00000020:01000004:3.0:1788592585.831872:0:7614:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788592585.831894:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788592585.831898:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788592585.831903:0:7614:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788592585.831926:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788592585.831931:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788592585.870261:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788592585.870304:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788592585.870308:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788592585.870310:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788592585.870312:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592585.870313:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592585.870315:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592585.870316:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592585.870318:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788592585.870319:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592585.870321:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592585.870322:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592585.870323:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592585.870328:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788592585.870330:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788592585.870332:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788592585.870333:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592585.870334:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592585.870335:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592585.870336:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592585.870337:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788592585.870338:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788592585.870339:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788592585.870340:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592585.870345:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592585.870411:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788592585.870433:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147273728:0@lo:253: 00000100:00100000:1.0:1788592585.870521:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.870609:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981977099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592585.870783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273728 00000100:00100000:2.0:1788592585.870792:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273728 00000100:00100000:2.0:1788592585.870849:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592585.870860:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:7614:x1875475147273728:12345-0@lo:253: 20000000:01000000:2.0:1788592585.870908:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788592585.870912:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788592585.870918:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788592585.870922:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788592585.872041:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592585.872278:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788592585.872294:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788592585.872335:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788592585.872342:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788592585.872408:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788592585.872464:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788592585.872917:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788592585.872939:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:2.0:1788592585.872942:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788592585.872979:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788592585.872988:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788592585.873038:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788592585.873062:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:2.0:1788592585.873099:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788592585.873109:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788592585.873145:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788592585.873218:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788592585.876878:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788592585.876919:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.120@tcp 20000000:01000000:2.0:1788592585.876923:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.120@tcp (null) (null) (null) 00000040:00080000:2.0:1788592585.876966:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788592585.876974:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788592585.877009:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788592585.877017:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.120@tcp (null) (null) 00000040:00080000:2.0:1788592585.877049:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788592585.877058:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788592585.877146:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788592585.877184:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788592585.877292:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788592585.877296:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788592585.877303:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788592585.877305:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788592585.877307:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788592585.877529:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788592585.877533:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788592585.877586:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788592585.877589:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788592585.881458:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788592585.881561:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788592585.881634:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788592585.884748:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788592585.884799:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788592585.884885:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788592585.885008:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788592585.885012:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788592585.886094:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788592585.886839:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788592585.886881:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788592585.886990:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788592585.887004:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788592585.887007:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788592585.887962:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788592585.888028:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788592585.888102:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788592585.888652:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788592585.888698:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788592585.888731:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788592585.888742:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788592585.888745:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788592585.890693:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788592585.890794:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788592585.890830:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788592585.891506:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788592585.891557:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788592585.891630:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1788592585.891653:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788592585.891677:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891697:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510817 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891705:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510841 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891727:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251086b expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891734:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510887 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891741:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891750:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891799:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891818:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.891836:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147273856:0@lo:104: 00000100:00100000:0.0:1788592585.891915:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592585.891965:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510887 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.891974:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510887 expref: 16 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.891983:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147273984:0@lo:104: 00010000:00010000:0.0:1788592585.892008:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f13251086b expref: 16 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.892026:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f13251086b expref: 16 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.892036:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274112:0@lo:104: 00010000:00010000:0.0:1788592585.892062:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510841 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.892071:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510841 expref: 16 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.892078:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274240:0@lo:104: 00010000:00010000:0.0:1788592585.892102:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510817 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.892110:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510817 expref: 16 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.892119:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274368:0@lo:104: 00000100:00100000:0.0:1788592585.892151:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab540 going to sleep for 11 seconds 00000100:00100000:2.0:1788592585.892274:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788592585.892303:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.892815:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.893809:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.893847:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273856 00000100:00100000:1.0:1788592585.893858:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273856 00000100:00100000:1.0:1788592585.893983:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147273984 00000100:00100000:1.0:1788592585.893987:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147273984 00000100:00100000:1.0:1788592585.894000:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274112 00000100:00100000:1.0:1788592585.894003:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274112 00000100:00100000:1.0:1788592585.894016:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592585.894025:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:5815:x1875475147273856:12345-0@lo:104: 00010000:00010000:1.0:1788592585.894046:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894185:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592585.894192:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193ae2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:5815:x1875475147273856:12345-0@lo:104: Request processed in 168us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592585.894209:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592585.894265:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592585.894272:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147273984:12345-0@lo:104: 00010000:00010000:1.0:1788592585.894290:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894336:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788592585.894341:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147273984:12345-0@lo:104: Request processed in 71us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592585.894369:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592585.894384:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592585.894390:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147274112:12345-0@lo:104: 00010000:00010000:1.0:1788592585.894398:0:5807:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894426:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788592585.894430:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147274112:12345-0@lo:104: Request processed in 42us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592585.894436:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788592585.894482:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788592585.894489:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894496:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dfc00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592585.894501:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894510:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592585.894518:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592585.894525:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592585.894578:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894585:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592585.894617:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894624:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108b8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894642:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592585.894645:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894651:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dfe00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592585.894654:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894660:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592585.894667:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592585.894672:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592585.894685:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894691:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592585.894705:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894722:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f132510887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251088e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894732:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592585.894735:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894741:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592585.894744:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894751:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592585.894757:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592585.894761:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592585.894775:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894780:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592585.894785:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894792:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f13251086b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510872 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.894800:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592585.894808:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592585.894810:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592585.894826:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147274752:0@lo:103: 00000100:00100000:1.0:1788592585.894868:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592585.895153:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592585.895163:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592585.895175:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147274496:0@lo:103: 00000100:00100000:3.0:1788592585.895217:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592585.895252:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274752 00000100:00100000:3.0:1788592585.895258:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274752 00010000:00010000:3.0:1788592585.895294:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251086b expref: 17 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592585.895319:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274496 00000100:00100000:3.0:1788592585.895322:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274496 00010000:00010000:3.0:1788592585.895379:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 18 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592585.895395:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592585.895402:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3284:x1875475147274752:12345-0@lo:103: 00010000:00010000:3.0:1788592585.895415:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592585.895420:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251086b expref: 18 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.895432:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f13251086b expref: 18 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.895452:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592585.895491:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3284:x1875475147274752:12345-0@lo:103: Request processed in 90us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.895498:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592585.895516:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592585.895523:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3285:x1875475147274496:12345-0@lo:103: 00010000:00010000:3.0:1788592585.895532:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592585.895536:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 17 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.895546:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 17 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.895556:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592585.895583:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3285:x1875475147274496:12345-0@lo:103: Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.895589:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592585.895818:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147274752:0@lo:103: 00000100:00100000:1.0:1788592585.895837:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592585.895844:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147274624:0@lo:103: 00000100:00100000:1.0:1788592585.895869:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.896013:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274624 00000100:00100000:1.0:1788592585.896018:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274624 00010000:00010000:1.0:1788592585.896035:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510887 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592585.896055:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592585.896061:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3284:x1875475147274624:12345-0@lo:103: 00010000:00010000:1.0:1788592585.896069:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592585.896074:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510887 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.896083:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510887 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.896095:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592585.896123:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3284:x1875475147274624:12345-0@lo:103: Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592585.896129:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592585.896241:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.896254:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274240 00000100:00100000:2.0:1788592585.896258:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274240 00000100:00100000:2.0:1788592585.896290:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274368 00000100:00100000:2.0:1788592585.896293:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274368 00000100:00100000:2.0:1788592585.896308:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592585.896314:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147274240:12345-0@lo:104: 00010000:00010000:2.0:1788592585.896323:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896379:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592585.896385:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:5815:x1875475147274240:12345-0@lo:104: Request processed in 72us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.896391:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592585.896402:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592585.896407:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147274368:12345-0@lo:104: 00010000:00010000:2.0:1788592585.896414:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896440:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788592585.896445:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5815:x1875475147274368:12345-0@lo:104: Request processed in 38us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.896450:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788592585.896471:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592585.896478:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896484:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592585.896489:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896507:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592585.896513:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592585.896520:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592585.896550:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896558:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592585.896570:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896578:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c5600/0x27b316f132510841 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510848 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896592:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592585.896606:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896613:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813de800 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592585.896616:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896624:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592585.896631:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592585.896642:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592585.896657:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896663:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592585.896668:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896675:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813de800/0x27b316f132510817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251081e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896692:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592585.896694:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592585.896695:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592585.896705:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147275008:0@lo:103: 00000100:00100000:2.0:1788592585.896732:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.896765:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275008 00000100:00100000:2.0:1788592585.896769:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275008 00010000:00010000:2.0:1788592585.896784:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510817 expref: 17 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592585.896800:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592585.896806:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3286:x1875475147275008:12345-0@lo:103: 00010000:00010000:2.0:1788592585.896814:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592585.896818:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510817 expref: 17 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896827:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510817 expref: 17 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.896845:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592585.896872:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3286:x1875475147275008:12345-0@lo:103: Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.896879:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788592585.897532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592585.897582:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147274496:0@lo:103: 00000100:00100000:3.0:1788592585.897619:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147274880:0@lo:103: 00000100:00100000:3.0:1788592585.897656:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592585.897699:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147274880 00000100:00100000:3.0:1788592585.897704:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147274880 00010000:00010000:3.0:1788592585.897726:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510841 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592585.897749:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592585.897756:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3285:x1875475147274880:12345-0@lo:103: 00010000:00010000:3.0:1788592585.897765:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592585.897779:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510841 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897788:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510841 expref: 17 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897804:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897813:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897828:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897836:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897843:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897849:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897855:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592585.897860:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897869:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.897878:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.898007:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592585.898044:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3285:x1875475147274880:12345-0@lo:103: Request processed in 288us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.898051:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592585.898084:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147274880:0@lo:103: 00000100:00100000:1.0:1788592585.898178:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147274624:0@lo:103: 00000100:00100000:3.0:1788592585.898431:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147275008:0@lo:103: 00010000:00010000:0.0:1788592585.899394:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fa00/0x27b316f1325108b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f1325108b1 expref: 16 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.899413:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147273856:0@lo:104: 00010000:00010000:0.0:1788592585.899427:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fe00/0x27b316f13251088e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510887 expref: 15 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.899438:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147273984:0@lo:104: 00010000:00010000:0.0:1788592585.899466:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5800/0x27b316f132510872 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f13251086b expref: 14 pid: 5817 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.899475:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274112:0@lo:104: 00010000:00010000:0.0:1788592585.899486:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813df800/0x27b316f132510848 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510841 expref: 13 pid: 5815 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.899499:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274240:0@lo:104: 00010000:00010000:0.0:1788592585.899509:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e8000/0x27b316f13251081e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510817 expref: 12 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.899518:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5815:1875475147274368:0@lo:104: 00010000:00010000:0.0:1788592585.899547:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.899556:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.899563:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.899569:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e000/0x27b316f1325108cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592585.899588:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788592585.947928:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:7614:x1875475147273728:12345-0@lo:253: Request processed in 77058us (77395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.947947:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788592585.948053:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147273728:0@lo:253: 10000000:01000000:1.0:1788592585.948087:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788592585.948090:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788592585.948092:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788592585.948093:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592585.948094:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788592585.948096:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592585.948097:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592585.948098:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788592585.948100:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788592585.948102:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592585.948103:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788592585.948124:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89819840e800 from lustre-OST0001 10000000:01000000:1.0:1788592585.948150:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788592585.948153:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592585.948163:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8981884acd40 local copy 10000000:01000000:1.0:1788592585.948167:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788592585.948276:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.948472:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.948483:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.948585:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275136:0@lo:101: 00000100:00100000:0.0:1788592585.948642:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592585.948720:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9aba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592585.948758:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275136 00000100:00100000:2.0:1788592585.948767:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275136 00000100:00100000:2.0:1788592585.948847:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592585.948858:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:7614:x1875475147275136:12345-0@lo:101: 00010000:00010000:2.0:1788592585.948871:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592585.948888:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e9000/0x27b316f1325108db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325108d4 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.948913:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e9000/0x27b316f1325108db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325108d4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.948925:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e9000/0x27b316f1325108db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108d4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592585.948935:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e9000, rc 0) 00000100:00100000:2.0:1788592585.948980:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275136:12345-0@lo:101: Request processed in 123us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.948986:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788592585.949052:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275136:0@lo:101: 00010000:00010000:1.0:1788592585.949067:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.949077:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592585.949182:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275264:0@lo:501: 00000100:00100000:1.0:1788592585.949235:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.949575:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.949661:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275264 00000100:00100000:0.0:1788592585.949675:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275264 00000100:00100000:0.0:1788592585.949703:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788592585.949710:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275264:12345-0@lo:501: 00000100:00100000:0.0:1788592585.949930:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275264:12345-0@lo:501: Request processed in 219us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592585.949938:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592585.950013:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275264:0@lo:501: 10000000:01000000:1.0:1788592585.950030:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788592585.950063:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788592585.950070:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.950080:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.950087:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.950115:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592585.950139:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89819840e800 10000000:01000000:1.0:1788592585.950145:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788592585.950151:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592585.950153:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592585.950157:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788592585.950160:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592585.950182:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.950190:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.950275:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592585.950395:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275392:0@lo:101: 00000100:00100000:1.0:1788592585.950429:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.950447:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788592585.950517:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592585.950524:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950532:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dfe00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592585.950536:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950546:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592585.950554:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592585.950560:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788592585.950581:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950587:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592585.950616:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950624:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dfe00/0x27b316f1325108d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x27b316f1325108db expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950653:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592585.950655:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592585.950657:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592585.950666:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592585.950679:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147275520:0@lo:103: 00000100:00100000:0.0:1788592585.950706:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592585.950745:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275520 00000100:00100000:0.0:1788592585.950750:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275520 00000100:00100000:0.0:1788592585.950787:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592585.950794:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3284:x1875475147275520:12345-0@lo:103: 00010000:00010000:0.0:1788592585.950804:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592585.950819:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e9000/0x27b316f1325108db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f1325108d4 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950834:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592585.950861:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:3284:x1875475147275520:12345-0@lo:103: Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.950868:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592585.950889:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275392 00000100:00100000:0.0:1788592585.950892:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275392 00000100:00100000:0.0:1788592585.950908:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788592585.950913:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+11:7614:x1875475147275392:12345-0@lo:101: 00010000:00010000:0.0:1788592585.950922:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592585.950934:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325108e2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950952:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325108e2 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950969:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108e2 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.950976:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e000, rc 0) 00000100:00100000:0.0:1788592585.951002:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275392:12345-0@lo:101: Request processed in 89us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.951008:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788592585.951041:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147275520:0@lo:103: 00000100:00100000:1.0:1788592585.951113:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275392:0@lo:101: 00010000:00010000:1.0:1788592585.951124:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592585.951132:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592585.951385:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275648:0@lo:501: 00000100:00100000:1.0:1788592585.951416:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.951437:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.951531:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275648 00000100:00100000:0.0:1788592585.951535:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275648 00000100:00100000:0.0:1788592585.951556:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788592585.951562:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275648:12345-0@lo:501: 00000100:00100000:0.0:1788592585.951790:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275648:12345-0@lo:501: Request processed in 227us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.951798:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788592585.952046:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275648:0@lo:501: 00000100:00100000:1.0:1788592585.952082:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275776:0@lo:503: 00000100:00100000:1.0:1788592585.952126:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.952158:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.952210:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275776 00000100:00100000:0.0:1788592585.952216:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275776 00000100:00100000:0.0:1788592585.952249:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788592585.952256:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275776:12345-0@lo:503: 00000100:00100000:0.0:1788592585.952718:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275776:12345-0@lo:503: Request processed in 461us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.952725:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592585.952806:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275776:0@lo:503: 00000040:00080000:1.0:1788592585.953098:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592585.953188:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275904:0@lo:502: 00000100:00100000:1.0:1788592585.953242:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592585.953277:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592585.953454:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147275904 00000100:00100000:2.0:1788592585.953461:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147275904 00000100:00100000:2.0:1788592585.953499:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592585.953506:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275904:12345-0@lo:502: 00000100:00100000:2.0:1788592585.953684:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147275904:12345-0@lo:502: Request processed in 178us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592585.953699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592585.953951:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147275904:0@lo:502: 00000040:00080000:2.0:1788592585.954267:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788592585.954522:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788592585.954561:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788592585.954631:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788592585.954673:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788592585.954709:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788592585.954746:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276032:0@lo:502: 00000100:00100000:2.0:1788592585.954799:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592585.954842:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.954902:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276032 00000100:00100000:0.0:1788592585.954909:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276032 00000100:00100000:0.0:1788592585.954945:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788592585.954953:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147276032:12345-0@lo:502: 00000100:00100000:0.0:1788592585.955149:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147276032:12345-0@lo:502: Request processed in 196us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.955157:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592585.955453:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276032:0@lo:502: 00000040:00080000:2.0:1788592585.955543:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788592585.955554:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788592585.956052:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788592585.956061:0:7623:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788592585.956069:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592585.956079:0:7623:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788592585.956085:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592585.956112:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8980863819c0) 00000020:00000080:1.0:1788592585.956136:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788592585.956143:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788592585.956402:0:7623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89819840e800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788592585.956411:0:7623:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788592585.956420:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27b316f1325108f7 00010000:00010000:2.0:1788592585.963734:0:7623:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788592585.964084:0:7623:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788592585.967027:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788592585.967647:0:7623:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788592585.972464:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788592585.973085:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788592585.975176:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788592585.975189:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592585.978376:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592585.978384:0:7623:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788592585.978397:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592585.978405:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592585.978407:0:7623:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788592585.978412:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788592585.978422:0:7623:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788592585.978499:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592585.978504:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592585.978506:0:7623:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788592585.978511:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788592585.979751:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788592585.979794:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788592585.979821:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.979835:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592585.979843:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819840e800 from 1 10000000:01000000:3.0:1788592585.979846:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592585.979894:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.979902:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.979916:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592585.979955:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276160:0@lo:101: 00000100:00100000:3.0:1788592585.980036:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592585.980079:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981933f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.980394:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276160 00000100:00100000:0.0:1788592585.980405:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276160 00000100:00100000:0.0:1788592585.980466:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788592585.980478:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:7614:x1875475147276160:12345-0@lo:101: 00010000:00010000:0.0:1788592585.980495:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592585.980513:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325108fe expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.980546:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325108fe expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.980558:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108fe expref: 13 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.980567:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fe00, rc 0) 00000100:00100000:0.0:1788592585.980634:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276160:12345-0@lo:101: Request processed in 158us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.980641:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788592585.980697:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276160:0@lo:101: 00010000:00010000:0.0:1788592585.980713:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.980723:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592585.980848:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276288:0@lo:501: 00000100:00100000:0.0:1788592585.980880:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592585.980904:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.980922:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276288 00000100:00100000:0.0:1788592585.980926:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276288 00000100:00100000:0.0:1788592585.980947:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592585.980953:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276288:12345-0@lo:501: 00000100:00100000:0.0:1788592585.981212:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276288:12345-0@lo:501: Request processed in 257us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592585.981220:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592585.981254:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276288:0@lo:501: 00010000:00010000:3.0:1788592585.983991:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592585.988261:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276416:0@lo:503: 00000100:00100000:0.0:1788592585.988548:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592585.988658:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592585.988947:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276416 00000100:00100000:3.0:1788592585.988959:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276416 00000100:00100000:3.0:1788592585.989056:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788592585.989069:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276416:12345-0@lo:503: 00000100:00100000:3.0:1788592585.989711:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276416:12345-0@lo:503: Request processed in 641us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.989721:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788592585.989826:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276416:0@lo:503: 00000040:00080000:0.0:1788592585.990167:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592585.990244:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276544:0@lo:502: 00000100:00100000:0.0:1788592585.990305:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592585.992218:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276544 00000100:00100000:3.0:1788592585.992232:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276544 00000100:00100000:0.0:1788592585.992258:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592585.992373:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788592585.992385:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276544:12345-0@lo:502: 00000100:00100000:3.0:1788592585.993406:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276544:12345-0@lo:502: Request processed in 1018us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592585.993418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592585.993422:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276544:0@lo:502: 00000040:00080000:0.0:1788592585.993753:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788592585.993808:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788592585.993848:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276672:0@lo:502: 00000100:00100000:0.0:1788592585.993898:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592585.993940:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592585.994045:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276672 00000100:00100000:1.0:1788592585.994054:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276672 00000100:00100000:1.0:1788592585.994098:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592585.994107:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276672:12345-0@lo:502: 00000100:00100000:1.0:1788592585.994448:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276672:12345-0@lo:502: Request processed in 340us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592585.994456:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788592585.994678:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276672:0@lo:502: 00000040:00080000:3.0:1788592585.994802:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788592585.994817:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788592585.998495:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592585.998511:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592585.998513:0:7627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788592585.998520:0:7627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89819840e800 00000020:00000080:0.0:1788592585.998523:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788592585.998547:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592585.998550:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592585.998552:0:7627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788592585.998555:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788592585.998944:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788592585.998983:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592585.999006:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.999039:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592585.999094:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788592585.999098:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89819840e800 10000000:01000000:3.0:1788592585.999101:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89819840e800 10000000:01000000:3.0:1788592585.999106:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592585.999113:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89819840e800 from 1 10000000:01000000:3.0:1788592585.999117:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592585.999162:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.999171:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592585.999184:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592585.999224:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276800:0@lo:101: 00000100:00100000:3.0:1788592585.999613:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592585.999660:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592585.999728:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276800 00000100:00100000:0.0:1788592585.999737:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276800 00000100:00100000:0.0:1788592585.999800:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788592585.999812:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147276800:12345-0@lo:101: 00010000:00010000:0.0:1788592585.999827:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592585.999842:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f13251090c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.999870:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f13251090c expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.999883:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251090c expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592585.999892:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fa00, rc 0) 00000100:00100000:0.0:1788592585.999949:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:7614:x1875475147276800:12345-0@lo:101: Request processed in 139us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.000147:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276800:0@lo:101: 00010000:00010000:2.0:1788592586.000164:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.000174:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592586.000315:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276928:0@lo:501: 00000100:00100000:2.0:1788592586.000346:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.000398:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fb40 going to sleep for 10 seconds 00000100:00100000:2.0:1788592586.000418:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147276928 00000100:00100000:2.0:1788592586.000423:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147276928 00000100:00100000:2.0:1788592586.000445:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788592586.000451:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147276928:12345-0@lo:501: 00000100:00100000:2.0:1788592586.000720:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147276928:12345-0@lo:501: Request processed in 268us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.000729:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788592586.000775:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147276928:0@lo:501: 00000100:00100000:2.0:1788592586.000808:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277056:0@lo:503: 00000100:00100000:2.0:1788592586.000850:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.000864:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592586.000877:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277056 00000100:00100000:2.0:1788592586.000880:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277056 00000100:00100000:2.0:1788592586.000905:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788592586.000911:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147277056:12345-0@lo:503: 00000100:00100000:2.0:1788592586.001079:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147277056:12345-0@lo:503: Request processed in 167us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.001085:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788592586.001125:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277056:0@lo:503: 00000040:00080000:2.0:1788592586.001501:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592586.001575:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277184:0@lo:502: 00000100:00100000:2.0:1788592586.001627:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.001654:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592586.001673:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277184 00000100:00100000:2.0:1788592586.001678:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277184 00000100:00100000:2.0:1788592586.001701:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592586.001706:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147277184:12345-0@lo:502: 00000100:00100000:2.0:1788592586.001897:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:7614:x1875475147277184:12345-0@lo:502: Request processed in 189us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.001904:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592586.001950:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277184:0@lo:502: 00000040:00080000:2.0:1788592586.002213:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788592586.002261:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788592586.002299:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788592586.002400:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788592586.002439:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788592586.002491:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788592586.002531:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788592586.002567:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788592586.002631:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788592586.002671:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788592586.002717:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788592586.002781:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788592586.002823:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788592586.002858:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788592586.002906:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788592586.002941:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000100:00100000:0.0:1788592586.003418:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000040:00080000:2.0:1788592586.003777:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788592586.003852:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788592586.003892:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788592586.004036:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788592586.004116:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788592586.004158:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788592586.004194:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788592586.004578:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788592586.004632:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788592586.004670:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788592586.004742:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788592586.004786:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1788592586.004822:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788592586.004873:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1788592586.004910:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1788592586.004947:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1788592586.005059:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1788592586.005114:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1788592586.005152:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1788592586.005750:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1788592586.005804:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1788592586.005867:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277312:0@lo:502: 00000100:00100000:2.0:1788592586.006023:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.006122:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592586.006275:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277312 00000100:00100000:0.0:1788592586.006861:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277312 00000100:00100000:2.0:1788592586.007127:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788592586.007139:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:7614:x1875475147277312:12345-0@lo:502: 00000100:00100000:2.0:1788592586.007874:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:7614:x1875475147277312:12345-0@lo:502: Request processed in 734us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.007884:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788592586.008143:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147277312:0@lo:502: 00000040:00080000:3.0:1788592586.008434:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788592586.008453:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788592586.009640:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788592586.009665:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff898086383380) 00000020:00000080:1.0:1788592586.009692:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788592586.009816:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89819840e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788592586.009820:0:7628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89819840e800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788592586.009823:0:7628:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89819840e800 3 00010000:00080000:1.0:1788592586.009860:0:7628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898084bc7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1788592586.014633:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788592586.014976:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788592586.015029:0:7628:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788592586.015045:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27b316f132510921 00000100:00080000:2.0:1788592586.015058:0:7628:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592586.015066:0:7628:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff898084bc7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1788592586.015122:0:7628:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc1e7100 x1875475147277440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592586.015187:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147277440:0@lo:38: 00000100:00100000:1.0:1788592586.015294:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592586.015445:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277440 00000100:00100000:0.0:1788592586.015463:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277440 00000100:00100000:0.0:1788592586.015509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788592586.015519:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147277440:12345-0@lo:38: 00010000:00080000:0.0:1788592586.015549:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1788592586.015602:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27b316f132510928 00000004:00100000:0.0:1788592586.015621:0:5822:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788592586.015660:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8981bbb89800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788592586.015889:0:7628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788592586.016058:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592586.016072:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147277568:0@lo:400: 00000100:00100000:2.0:1788592586.016125:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.016169:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277568 00000100:00100000:2.0:1788592586.016175:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277568 00000100:00100000:2.0:1788592586.016456:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592586.016466:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147277568:12345-0@lo:400: 00000100:00100000:2.0:1788592586.016515:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147277568:12345-0@lo:400: Request processed in 51us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.016523:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788592586.016571:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e7480 x1875475147277568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592586.016587:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147277568:0@lo:400: 00000100:00100000:2.0:1788592586.017442:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147277696:0@lo:400: 00000100:00100000:2.0:1788592586.017502:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.017538:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592586.017546:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147277824:0@lo:400: 00000100:00100000:2.0:1788592586.017576:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.017626:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277696 00000100:00100000:2.0:1788592586.017633:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277696 00000100:00100000:2.0:1788592586.017674:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592586.017684:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147277696:12345-0@lo:400: 00000100:00100000:2.0:1788592586.017728:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147277696:12345-0@lo:400: Request processed in 45us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.017735:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788592586.017757:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277824 00000100:00100000:2.0:1788592586.017761:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277824 00000100:00100000:2.0:1788592586.017789:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592586.017796:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147277824:12345-0@lo:400: 00000100:00100000:2.0:1788592586.017828:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147277824:12345-0@lo:400: Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.017836:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788592586.017876:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e4e00 x1875475147277824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592586.017888:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147277824:0@lo:400: 00010000:00080000:2.0:1788592586.017898:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e4380 x1875475147277696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592586.017907:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147277696:0@lo:400: 00000100:00080000:3.0:1788592586.021139:0:7630:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff898183e9a680 x1875475147277952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:2.0:1788592586.021145:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788592586.021165:0:7630:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554a900 going to sleep for 0 seconds 00000020:01000000:3.0:1788592586.021492:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788592586.021539:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788592586.021616:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592586.021630:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788592586.021697:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788592586.021700:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592586.021701:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592586.021703:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592586.021704:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592586.021705:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592586.021707:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592586.021709:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788592586.021711:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788592586.021712:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592586.021714:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788592586.021719:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788592586.021721:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788592586.021723:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592586.021724:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592586.021725:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592586.021726:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592586.021728:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592586.021729:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592586.021730:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788592586.021731:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788592586.021733:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592586.021734:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788592586.021754:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788592586.021766:0:7614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147278080:0@lo:253: 00000100:00100000:0.0:1788592586.021851:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875475147277440:12345-0@lo:38: Request processed in 6329us (6553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592586.021863:0:7614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592586.021865:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592586.021906:0:7614:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788592586.021930:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278080 00000100:00100000:3.0:1788592586.021938:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278080 00000100:00100000:3.0:1788592586.021991:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592586.022000:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:7614:x1875475147278080:12345-0@lo:253: 20000000:01000000:3.0:1788592586.022030:0:5818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788592586.022059:0:5818:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788592586.027175:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e7100 x1875475147277440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592586.027205:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592586.027218:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788592586.027230:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788592586.027248:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788592586.027253:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788592586.027264:0:3282:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a8aba577): req@ffff898183e9a680 x1875475147277952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592586.028009:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147277440:0@lo:38: 00000100:00100000:3.0:1788592586.028467:0:7630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592586.028524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147277952 00000100:00100000:3.0:1788592586.028531:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147277952 00000100:00100000:3.0:1788592586.028611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592586.028621:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875475147277952:12345-0@lo:901: 00000100:00100000:3.0:1788592586.030251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1875475147277952:12345-0@lo:901: Request processed in 1626us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592586.030263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788592586.030394:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788592586.030464:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898183e9a680 x1875475147277952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788592602 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592586.030480:0:7630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e9a680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1875475147277952:0@lo:901: 20000000:01000000:1.0:1788592586.063403:0:5818:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788592586.063421:0:5818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788592586.063545:0:5838:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788592586.063551:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788592586.063577:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.063607:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510879 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.063617:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.063670:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510879 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.063687:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510879 expref: 14 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592586.063702:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147278208:0@lo:104: 00000100:00100000:0.0:1788592586.063776:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592586.063827:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff898193144f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592586.063927:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278208 00000100:00100000:2.0:1788592586.063942:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278208 00000100:00100000:2.0:1788592586.064004:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592586.064014:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147278208:12345-0@lo:104: 00010000:00010000:2.0:1788592586.064029:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064092:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592586.064099:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:5838:x1875475147278208:12345-0@lo:104: Request processed in 88us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.064108:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788592586.064137:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592586.064144:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064152:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813df400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592586.064156:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064166:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592586.064174:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592586.064180:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788592586.064229:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064236:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592586.064252:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064267:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813df400/0x27b316f132510879 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510880 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.064517:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592586.064520:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592586.064522:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592586.064543:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147278336:0@lo:103: 00000100:00100000:2.0:1788592586.064581:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592586.064672:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5838:1875475147278208:0@lo:104: 00010000:00010000:2.0:1788592586.064696:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592586.064755:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278336 00000100:00100000:0.0:1788592586.064762:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278336 00010000:00010000:0.0:1788592586.064785:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510879 expref: 15 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592586.064815:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592586.064822:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:3283:x1875475147278336:12345-0@lo:103: 00010000:00010000:0.0:1788592586.064835:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592586.064840:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510879 expref: 15 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064852:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510879 expref: 15 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064868:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5400/0x27b316f132510880 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510879 expref: 15 pid: 5818 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064883:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064892:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788592586.064907:0:5809:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001650341s 00010000:00010000:0.0:1788592586.064912:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064920:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064927:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064945:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064952:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592586.064957:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064965:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064979:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592586.064988:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592586.065018:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3283:x1875475147278336:12345-0@lo:103: Request processed in 197us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592586.065026:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592586.065119:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147278336:0@lo:103: 00010000:00010000:2.0:1788592586.065137:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.065144:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592586.065150:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762ec00/0x27b316f13251092f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592586.076588:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:7614:x1875475147278080:12345-0@lo:253: Request processed in 54578us (54715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592586.076615:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788592586.076707:0:7614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3766d60d-7279-4c7a-a56f-5f796f49fe93:7614:1875475147278080:0@lo:253: 10000000:01000000:3.0:1788592586.076726:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788592586.076729:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788592586.076730:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788592586.076732:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788592586.076733:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788592586.076734:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788592586.076735:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788592586.076737:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788592586.076738:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788592586.076739:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788592586.076741:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788592586.076743:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788592586.076759:0:7614:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788592586.082504:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592586.082733:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592586.082992:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592586.083178:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788592586.084484:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592586.085109:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788592586.087523:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788592586.360416:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788592586.360424:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788592586.360469:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788592586.360553:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788592586.360572:0:7614:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788592586.360610:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788592587.008009:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592588.031816:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592589.054587:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592590.082756:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592590.594590:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147278464:0@lo:13: 00000100:00100000:1.0:1788592590.594688:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592590.594794:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278464 00000100:00100000:1.0:1788592590.594802:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278464 00000100:00100000:1.0:1788592590.596555:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592590.596582:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147278464:12345-0@lo:13: 00002000:00000024:1.0:1788592590.596629:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592590.596772:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147278464:12345-0@lo:13: Request processed in 200us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592590.596781:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788592590.596816:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788592590.600269:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba574000 x1875475147278464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592606 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592590.600305:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147278464:0@lo:13: 00000100:00100000:2.0:1788592591.102661:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147278848:0@lo:400: 00000100:00100000:2.0:1788592591.102756:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592591.102830:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592591.102836:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147278976:0@lo:400: 00000100:00100000:2.0:1788592591.102865:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592591.102911:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278848 00000100:00100000:2.0:1788592591.102919:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278848 00000100:00100000:2.0:1788592591.102994:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592591.103005:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147278848:12345-0@lo:400: 00000100:00100000:2.0:1788592591.103065:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147278848:12345-0@lo:400: Request processed in 62us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592591.103073:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592591.103098:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278976 00000100:00100000:2.0:1788592591.103102:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278976 00000100:00100000:2.0:1788592591.103128:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592591.103134:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147278976:12345-0@lo:400: 00000100:00100000:2.0:1788592591.103165:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147278976:12345-0@lo:400: Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592591.103171:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788592591.103186:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592591.103227:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085892300 x1875475147278976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592591.103255:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147278976:0@lo:400: 00010000:00080000:2.0:1788592591.103270:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890000 x1875475147278848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592591.103280:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147278848:0@lo:400: 00000100:00100000:0.0:1788592591.103535:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147278720:0@lo:400: 00000100:00100000:0.0:1788592591.103571:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592591.103591:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592591.103596:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147278592:0@lo:400: 00000100:00100000:0.0:1788592591.103625:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592591.103646:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147279104:0@lo:400: 00000100:00100000:0.0:1788592591.103675:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592591.103759:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278720 00000100:00100000:0.0:1788592591.103764:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278720 00000100:00100000:0.0:1788592591.103792:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279104 00000100:00100000:0.0:1788592591.103794:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279104 00000100:00100000:0.0:1788592591.103833:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592591.103838:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147278720:12345-0@lo:400: 00000100:00100000:0.0:1788592591.103878:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147278720:12345-0@lo:400: Request processed in 39us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592591.103885:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592591.103900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592591.103906:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147279104:12345-0@lo:400: 00000100:00100000:0.0:1788592591.103934:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147279104:12345-0@lo:400: Request processed in 28us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592591.103939:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788592591.103957:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788592591.103976:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085891500 x1875475147279104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592591.103986:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147279104:0@lo:400: 00010000:00080000:0.0:1788592591.103996:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085891c00 x1875475147278720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592591.104005:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147278720:0@lo:400: 00000100:00100000:2.0:1788592591.104141:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147278592 00000100:00100000:2.0:1788592591.104146:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147278592 00000100:00100000:2.0:1788592591.104179:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592591.104186:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3286:x1875475147278592:12345-0@lo:400: 00000100:00100000:2.0:1788592591.104226:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:3286:x1875475147278592:12345-0@lo:400: Request processed in 41us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592591.104232:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592591.104267:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147278592:0@lo:400: 00010000:00010000:3.0:1788592591.105647:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592592.126552:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592593.150683:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592593.540240:0:7971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788592594.177848:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592595.201768:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788592595.201777:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898188438800 from 30 10000000:01000000:3.0:1788592595.201783:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592595.201838:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.201852:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.201863:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592595.201892:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279232:0@lo:101: 00000100:00100000:3.0:1788592595.201968:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.202031:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.202191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279232 00000100:00100000:0.0:1788592595.202202:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279232 00000100:00100000:0.0:1788592595.202257:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788592595.202265:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147279232:12345-0@lo:101: 00010000:00010000:0.0:1788592595.202279:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592595.202292:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510936 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.202313:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510936 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.202762:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510936 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.202775:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e800, rc 0) 00000100:00100000:0.0:1788592595.202836:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279232:12345-0@lo:101: Request processed in 571us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.202843:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788592595.202926:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279232:0@lo:101: 00010000:00010000:3.0:1788592595.202944:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.202966:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592595.203024:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279360:0@lo:501: 00000100:00100000:3.0:1788592595.203053:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.203077:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14ba80 going to sleep for 11 seconds 00010000:00010000:1.0:1788592595.203729:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592595.203918:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279360 00000100:00100000:0.0:1788592595.203926:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279360 00000100:00100000:0.0:1788592595.203972:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788592595.203982:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279360:12345-0@lo:501: 00000100:00100000:0.0:1788592595.206326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279360:12345-0@lo:501: Request processed in 2335us (3260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.206381:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592595.207375:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279360:0@lo:501: 00000100:00100000:2.0:1788592595.207462:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279488:0@lo:503: 00000100:00100000:2.0:1788592595.207543:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.207588:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898198905000 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.207660:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279488 00000100:00100000:3.0:1788592595.207668:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279488 00000100:00100000:3.0:1788592595.207720:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788592595.207730:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279488:12345-0@lo:503: 00000100:00100000:3.0:1788592595.208117:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279488:12345-0@lo:503: Request processed in 386us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.208125:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788592595.209255:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279488:0@lo:503: 00000100:00100000:3.0:1788592595.213005:0:8049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8049:1875475147279616:0@lo:502: 00000100:00100000:3.0:1788592595.213125:0:8049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.216494:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279616 00000100:00100000:0.0:1788592595.216516:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279616 00000100:00100000:0.0:1788592595.216633:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788592595.216645:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8049:x1875475147279616:12345-0@lo:502: 00000100:00100000:0.0:1788592595.217469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8049:x1875475147279616:12345-0@lo:502: Request processed in 823us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.217480:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788592595.219384:0:8049:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592595.219444:0:8049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e9a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8049:1875475147279616:0@lo:502: 00000100:00100000:2.0:1788592595.219547:0:8049:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8049:1875475147279744:0@lo:502: 00000100:00100000:2.0:1788592595.219634:0:8049:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.221883:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279744 00000100:00100000:1.0:1788592595.221903:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279744 00000100:00100000:1.0:1788592595.221960:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788592595.221971:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8049:x1875475147279744:12345-0@lo:502: 00000100:00100000:1.0:1788592595.222308:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8049:x1875475147279744:12345-0@lo:502: Request processed in 338us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.222326:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592595.230628:0:8049:0:(client.c:2716:ptlrpc_set_wait()) set ffff898198905000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.230695:0:8049:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8049:1875475147279744:0@lo:502: 00000040:00080000:0.0:1788592595.230755:0:8049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788592595.231775:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788592595.231806:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592595.231822:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.231839:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592595.231850:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788592595.231853:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788592595.231856:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592595.232330:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.232587:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.232600:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592595.232631:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279872:0@lo:101: 00000100:00100000:1.0:1788592595.232717:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.232813:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.234526:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147279872 00000100:00100000:3.0:1788592595.234544:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147279872 00000100:00100000:3.0:1788592595.234611:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788592595.234622:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147279872:12345-0@lo:101: 00010000:00010000:3.0:1788592595.234640:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592595.234661:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510944 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.234691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510944 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.234702:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510944 expref: 15 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.234731:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592595.234883:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147279872:12345-0@lo:101: Request processed in 262us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.234891:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788592595.234965:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147279872:0@lo:101: 00010000:00010000:3.0:1788592595.234990:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.235000:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592595.235082:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280000:0@lo:501: 00000100:00100000:3.0:1788592595.235117:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.235149:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.235244:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280000 00000100:00100000:3.0:1788592595.235249:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280000 00000100:00100000:3.0:1788592595.235281:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788592595.235287:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147280000:12345-0@lo:501: 00000100:00100000:3.0:1788592595.235671:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147280000:12345-0@lo:501: Request processed in 383us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.235678:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788592595.235713:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280000:0@lo:501: 00000100:00100000:3.0:1788592595.235745:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280128:0@lo:503: 00000100:00100000:3.0:1788592595.235787:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.235807:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.235828:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280128 00000100:00100000:3.0:1788592595.235832:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280128 00000100:00100000:3.0:1788592595.235857:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788592595.235863:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147280128:12345-0@lo:503: 00000100:00100000:3.0:1788592595.236666:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147280128:12345-0@lo:503: Request processed in 798us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.236677:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788592595.236739:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280128:0@lo:503: 00000100:00100000:0.0:1788592595.246511:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8050:1875475147280256:0@lo:502: 00000100:00100000:0.0:1788592595.246641:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.246693:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187f07300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.246821:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280256 00000100:00100000:3.0:1788592595.246830:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280256 00000100:00100000:3.0:1788592595.246895:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788592595.246912:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8050:x1875475147280256:12345-0@lo:502: 00000100:00100000:3.0:1788592595.247427:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8050:x1875475147280256:12345-0@lo:502: Request processed in 422us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.247438:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788592595.248028:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8050:1875475147280256:0@lo:502: 00000020:01000000:0.0:1788592595.248071:0:8050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592595.248083:0:8050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592595.248086:0:8050:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788592595.248094:0:8050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788592595.248096:0:8050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788592595.248130:0:8050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8050:1875475147280384:0@lo:502: 00000100:00100000:0.0:1788592595.248266:0:8050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.248299:0:8050:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187f07300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.249271:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280384 00000100:00100000:3.0:1788592595.249281:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280384 00000100:00100000:3.0:1788592595.249366:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592595.249378:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8050:x1875475147280384:12345-0@lo:502: 00000100:00100000:3.0:1788592595.249684:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8050:x1875475147280384:12345-0@lo:502: Request processed in 307us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592595.249693:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788592595.252533:0:8050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8050:1875475147280384:0@lo:502: 00000020:01000000:1.0:1788592595.252602:0:8050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592595.252616:0:8050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592595.252619:0:8050:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788592595.252624:0:8050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788592595.252858:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788592595.252885:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788592595.252898:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.252928:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592595.252942:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788592595.252944:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898190067800 from 30 10000000:01000000:3.0:1788592595.252947:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788592595.252989:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.252997:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.253008:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592595.253029:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280512:0@lo:101: 00000100:00100000:3.0:1788592595.253104:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.253325:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.253499:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280512 00000100:00100000:1.0:1788592595.253507:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280512 00000100:00100000:1.0:1788592595.253569:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788592595.253579:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147280512:12345-0@lo:101: 00010000:00010000:1.0:1788592595.253592:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592595.253607:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510952 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.253632:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510952 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.253644:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510952 expref: 16 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.253655:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813dfa00, rc 0) 00000100:00100000:1.0:1788592595.253702:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147280512:12345-0@lo:101: Request processed in 125us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.253709:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592595.253949:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280512:0@lo:101: 00010000:00010000:3.0:1788592595.253966:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592595.253977:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592595.254037:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280640:0@lo:501: 00000100:00100000:3.0:1788592595.254065:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.254627:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.254824:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280640 00000100:00100000:1.0:1788592595.254830:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280640 00000100:00100000:1.0:1788592595.254914:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788592595.254925:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147280640:12345-0@lo:501: 00000100:00100000:1.0:1788592595.255501:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147280640:12345-0@lo:501: Request processed in 576us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.255512:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592595.258266:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280640:0@lo:501: 00000100:00100000:3.0:1788592595.258367:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280768:0@lo:503: 00000100:00100000:3.0:1788592595.258724:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.258965:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.259129:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280768 00000100:00100000:0.0:1788592595.259138:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280768 00000100:00100000:0.0:1788592595.259206:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788592595.259217:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147280768:12345-0@lo:503: 00000100:00100000:0.0:1788592595.260528:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147280768:12345-0@lo:503: Request processed in 1305us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.260542:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788592595.262499:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147280768:0@lo:503: 00000100:00100000:3.0:1788592595.263540:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8052:1875475147280896:0@lo:502: 00000100:00100000:3.0:1788592595.263664:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.263718:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.264041:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147280896 00000100:00100000:0.0:1788592595.264051:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147280896 00000100:00100000:0.0:1788592595.264117:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788592595.264128:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8052:x1875475147280896:12345-0@lo:502: 00000100:00100000:0.0:1788592595.264857:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8052:x1875475147280896:12345-0@lo:502: Request processed in 726us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.264866:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788592595.267323:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8052:1875475147280896:0@lo:502: 00000100:00100000:0.0:1788592595.267660:0:8052:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8052:1875475147281024:0@lo:502: 00000100:00100000:0.0:1788592595.268012:0:8052:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.268107:0:8052:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185de0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.273465:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281024 00000100:00100000:1.0:1788592595.273484:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281024 00000100:00100000:1.0:1788592595.273558:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788592595.273571:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8052:x1875475147281024:12345-0@lo:502: 00000100:00100000:1.0:1788592595.274111:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8052:x1875475147281024:12345-0@lo:502: Request processed in 541us (6096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.274121:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788592595.278749:0:8052:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8052:1875475147281024:0@lo:502: 00000040:00080000:1.0:1788592595.283483:0:8052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788592595.284014:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788592595.284120:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592595.284133:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.284148:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592595.284159:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592595.284162:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff898190067800 from 5 10000000:01000000:2.0:1788592595.284166:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592595.284215:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.284225:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.284236:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592595.284265:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281152:0@lo:101: 00000100:00100000:2.0:1788592595.289527:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.289653:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.290002:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281152 00000100:00100000:0.0:1788592595.290014:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281152 00000100:00100000:0.0:1788592595.290481:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788592595.290494:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147281152:12345-0@lo:101: 00010000:00010000:0.0:1788592595.290515:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592595.290541:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762f400/0x27b316f132510967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510960 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.290574:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762f400/0x27b316f132510967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510960 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.290586:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762f400/0x27b316f132510967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510960 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.290598:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762f400, rc 0) 00000100:00100000:0.0:1788592595.290675:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147281152:12345-0@lo:101: Request processed in 183us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.290682:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788592595.292057:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281152:0@lo:101: 00010000:00010000:2.0:1788592595.292091:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.292104:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592595.292204:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281280:0@lo:256: 00000100:00100000:2.0:1788592595.292271:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.299205:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.303801:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281280 00000100:00100000:1.0:1788592595.303823:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281280 00000100:00100000:1.0:1788592595.303950:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788592595.303963:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147281280:12345-0@lo:256: 20000000:01000000:1.0:1788592595.303996:0:5817:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788592595.304026:0:5817:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788592595.304030:0:5817:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788592595.304221:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147281280:12345-0@lo:256: Request processed in 260us (11949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.304230:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788592595.304388:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281280:0@lo:256: 10000000:01000000:2.0:1788592595.304465:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592595.304478:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.304490:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592595.304500:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788592595.304504:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788592595.304508:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788592595.304549:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.304558:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.304569:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592595.304595:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281408:0@lo:101: 00000100:00100000:2.0:1788592595.304635:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.304670:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.305025:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281408 00000100:00100000:1.0:1788592595.305032:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281408 00000100:00100000:1.0:1788592595.305065:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788592595.305074:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147281408:12345-0@lo:101: 00010000:00010000:1.0:1788592595.305085:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592595.305101:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f13251096e expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.305128:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.305142:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592595.305151:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813de800, rc 0) 00000100:00100000:1.0:1788592595.305215:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147281408:12345-0@lo:101: Request processed in 142us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.305222:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788592595.305345:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281408:0@lo:101: 00010000:00010000:2.0:1788592595.305396:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592595.305407:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592595.305479:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281536:0@lo:501: 00000100:00100000:2.0:1788592595.305509:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.305528:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.305590:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281536 00000100:00100000:0.0:1788592595.305595:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281536 00000100:00100000:0.0:1788592595.305622:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788592595.305629:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147281536:12345-0@lo:501: 00000100:00100000:0.0:1788592595.305967:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147281536:12345-0@lo:501: Request processed in 331us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.305974:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788592595.308551:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281536:0@lo:501: 00000100:00100000:2.0:1788592595.308636:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281664:0@lo:503: 00000100:00100000:2.0:1788592595.308729:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.308770:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.309024:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281664 00000100:00100000:1.0:1788592595.309032:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281664 00000100:00100000:1.0:1788592595.309089:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788592595.309100:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147281664:12345-0@lo:503: 00000100:00100000:1.0:1788592595.309592:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147281664:12345-0@lo:503: Request processed in 492us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.309601:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592595.309730:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147281664:0@lo:503: 00000100:00100000:2.0:1788592595.310517:0:8056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8056:1875475147281792:0@lo:502: 00000100:00100000:2.0:1788592595.310579:0:8056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.310619:0:8056:0:(client.c:2716:ptlrpc_set_wait()) set ffff898198905a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.310661:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281792 00000100:00100000:1.0:1788592595.310668:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281792 00000100:00100000:1.0:1788592595.310710:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592595.310719:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8056:x1875475147281792:12345-0@lo:502: 00000100:00100000:1.0:1788592595.311319:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8056:x1875475147281792:12345-0@lo:502: Request processed in 592us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.311328:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788592595.311512:0:8056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8056:1875475147281792:0@lo:502: 00000020:01000000:2.0:1788592595.311543:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592595.311552:0:8056:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788592595.311560:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592595.311563:0:8056:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788592595.311568:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592595.311572:0:8056:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1788592595.311596:0:8056:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788592595.311599:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592595.311624:0:8056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff898198498000) 00000020:00000080:2.0:1788592595.311649:0:8056:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788592595.311656:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592595.311728:0:8056:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788592595.311734:0:8056:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788592595.311741:0:8056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132510983 00010000:00080000:2.0:1788592595.311770:0:8056:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898184fcf000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1788592595.312033:0:8056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788592595.312449:0:8056:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788592595.312465:0:8056:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788592595.313197:0:8056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592595.313475:0:8056:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592595.313532:0:8056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788592595.313591:0:8056:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788592595.317378:0:8057:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592595.317391:0:8057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788592595.319393:0:8056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788592595.319414:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788592595.319469:0:8056:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788592595.319498:0:8056:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f13251098a 00000100:00080000:1.0:1788592595.319513:0:8056:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788592595.319521:0:8056:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898184fcf000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592595.319574:0:8056:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981ba575500 x1875475147281920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592595.319601:0:8056:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788592595.319661:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592595.319677:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592595.319679:0:8056:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788592595.319683:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592595.319688:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592595.319689:0:8056:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788592595.319692:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788592595.319695:0:8056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788592595.319728:0:8056:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8056:1875475147282048:0@lo:502: 00000100:00100000:1.0:1788592595.319834:0:8056:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.319892:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282048 00000100:00100000:1.0:1788592595.319900:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282048 00000100:00100000:1.0:1788592595.319952:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788592595.319963:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8056:x1875475147282048:12345-0@lo:502: 00000100:00100000:1.0:1788592595.320243:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8056:x1875475147282048:12345-0@lo:502: Request processed in 280us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.320251:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788592595.320785:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147282176:0@lo:400: 00000100:00100000:2.0:1788592595.320827:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.320863:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592595.320870:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147282560:0@lo:400: 00000100:00100000:2.0:1788592595.320898:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.320941:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147282304:0@lo:400: 00000100:00100000:2.0:1788592595.320964:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.320985:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592595.320990:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147282432:0@lo:400: 00000100:00100000:2.0:1788592595.321017:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.321053:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282176 00000100:00100000:2.0:1788592595.321059:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282176 00000100:00100000:2.0:1788592595.321095:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282560 00000100:00100000:2.0:1788592595.321098:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282560 00000100:00100000:2.0:1788592595.321124:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282304 00000100:00100000:2.0:1788592595.321127:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282304 00000100:00100000:2.0:1788592595.321144:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592595.321152:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147282176:12345-0@lo:400: 00000100:00100000:2.0:1788592595.321248:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147282176:12345-0@lo:400: Request processed in 96us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.321268:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592595.321286:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788592595.321293:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147282560:12345-0@lo:400: 00000100:00100000:2.0:1788592595.321325:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147282560:12345-0@lo:400: Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.321331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788592595.321342:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592595.321347:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147282304:12345-0@lo:400: 00000100:00100000:2.0:1788592595.321403:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147282304:12345-0@lo:400: Request processed in 57us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.321409:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788592595.321445:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282432 00000100:00100000:2.0:1788592595.321449:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282432 00000100:00100000:2.0:1788592595.321478:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592595.321485:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147282432:12345-0@lo:400: 00000100:00100000:2.0:1788592595.321513:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147282432:12345-0@lo:400: Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.321519:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788592595.321536:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592595.321540:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592595.321572:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890700 x1875475147282432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.321587:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147282432:0@lo:400: 00010000:00080000:2.0:1788592595.321599:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085892300 x1875475147282304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.321620:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147282304:0@lo:400: 00010000:00080000:2.0:1788592595.321650:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085891880 x1875475147282560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.321656:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147282560:0@lo:400: 00010000:00080000:2.0:1788592595.321664:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890000 x1875475147282176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.321671:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147282176:0@lo:400: 00000100:00100000:0.0:1788592595.321761:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147281920:0@lo:8: 00000100:00100000:0.0:1788592595.321797:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.322037:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147281920 00000100:00100000:2.0:1788592595.322042:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147281920 00000100:00100000:2.0:1788592595.322076:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592595.322082:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147281920:12345-0@lo:8: 00010000:00080000:2.0:1788592595.322111:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1788592595.322144:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132510991 00002000:00100000:2.0:1788592595.322159:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff898184fcb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788592595.322164:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788592595.322168:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788592595.322321:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788592595.322542:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788592595.322574:0:6676:0:(import.c:65:import_set_state_nolock()) ffff898184fcb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592595.322640:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875475147281920:12345-0@lo:8: Request processed in 556us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.322648:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788592595.322689:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba575500 x1875475147281920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.322717:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592595.322726:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788592595.322735:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592595.322742:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788592595.322745:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898184fcf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592595.322762:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592595.322768:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147281920:0@lo:8: 00000004:00080000:2.0:1788592595.322798:0:8057:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788592595.322950:0:8057:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 169563598934ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788592595.323335:0:8056:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185c44540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.323494:0:8056:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8056:1875475147282048:0@lo:502: 00000020:01000000:1.0:1788592595.323539:0:8056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592595.323547:0:8056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592595.323550:0:8056:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788592595.323555:0:8056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788592595.330883:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788592595.331176:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788592595.331190:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.331205:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592595.331228:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788592595.331232:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8981884acd40 from 1 10000000:01000000:0.0:1788592595.331235:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788592595.331283:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.331292:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.331302:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592595.331471:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147282688:0@lo:101: 00000100:00100000:0.0:1788592595.331556:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.331686:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282688 00000100:00100000:0.0:1788592595.331696:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282688 00000100:00100000:0.0:1788592595.331754:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788592595.336780:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147282688:12345-0@lo:101: 00010000:00010000:0.0:1788592595.336820:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592595.336993:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510998 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.337034:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510998 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.337047:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510998 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.337057:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e200, rc 0) 00000100:00100000:0.0:1788592595.338572:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147282688:12345-0@lo:101: Request processed in 6798us (7006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.341666:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788592595.341807:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185de0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592595.341853:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147282688:0@lo:101: 00010000:00010000:0.0:1788592595.341890:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.341906:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592595.342002:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147282816:0@lo:501: 00000100:00100000:0.0:1788592595.342075:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592595.342117:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592595.344131:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282816 00000100:00100000:2.0:1788592595.344151:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282816 00000100:00100000:2.0:1788592595.344211:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788592595.344223:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147282816:12345-0@lo:501: 00000100:00100000:2.0:1788592595.344639:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147282816:12345-0@lo:501: Request processed in 418us (2563us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592595.344647:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788592595.348431:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147282816:0@lo:501: 10000000:01000000:0.0:1788592595.348501:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788592595.348513:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592595.348540:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592595.412800:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788592595.530758:0:8058:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788592595.530801:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283072:0@lo:7: 00000100:00100000:1.0:1788592595.530898:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.530971:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184ee4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.530991:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147282944:0@lo:13: 00000100:00100000:1.0:1788592595.531147:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.531204:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283072 00000100:00100000:1.0:1788592595.531212:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283072 00000100:00100000:1.0:1788592595.531274:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592595.531285:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8058:x1875475147283072:12345-0@lo:7: 00000100:00080000:2.0:1788592595.535768:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592595.535797:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147282944 00000100:00100000:2.0:1788592595.535811:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147282944 00000100:00100000:2.0:1788592595.535877:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592595.535889:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875475147282944:12345-0@lo:13: 00002000:00000024:2.0:1788592595.535927:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788592595.536046:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875475147282944:12345-0@lo:13: Request processed in 160us (4898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592595.536054:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788592595.538758:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba576a00 x1875475147282944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592595.538793:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147282944:0@lo:13: 00002000:00080000:1.0:1788592595.541635:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788592595.541646:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788592595.541855:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8058:x1875475147283072:12345-0@lo:7: Request processed in 10566us (10950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.541868:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788592595.542200:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba575c00 x1875475147283072/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788592611 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.542231:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283072:0@lo:7: 00000004:00080000:2.0:1788592595.542251:0:8058:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788592595.542301:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283200:0@lo:5: 00000100:00100000:2.0:1788592595.543242:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592595.543311:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185e8e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592595.545304:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283200 00000100:00100000:3.0:1788592595.545321:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283200 00000100:00100000:3.0:1788592595.545402:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788592595.545425:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8058:x1875475147283200:12345-0@lo:5: 00002000:00080000:3.0:1788592595.545461:0:6678:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788592595.545466:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:1.0:1788592595.546289:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890000 x1875475147283200/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592611 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592595.546313:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283200:0@lo:5: 00000100:00100000:3.0:1788592595.546317:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8058:x1875475147283200:12345-0@lo:5: Request processed in 847us (3020us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788592595.546326:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788592595.546329:0:8058:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788592595.546390:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283328:0@lo:700: 00000100:00100000:1.0:1788592595.546445:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.546488:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185c44540 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.546505:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283328 00000100:00100000:1.0:1788592595.546510:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283328 00000100:00100000:1.0:1788592595.546544:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592595.546552:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8058:x1875475147283328:12345-0@lo:700: 00000100:00100000:1.0:1788592595.546587:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875475147283456:0@lo:700: 00000100:00100000:1.0:1788592595.546616:0:6684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.546635:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a49e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.546666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283456 00000100:00100000:1.0:1788592595.546670:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283456 00000100:00100000:1.0:1788592595.546699:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592595.546705:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875475147283456:12345-0@lo:700: 40000000:02000000:1.0:1788592595.598129:0:5829:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788592595.613330:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6684:x1875475147283456:12345-0@lo:700: Request processed in 66610us (66699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.613382:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788592595.614745:0:6684:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba575c00 x1875475147283456/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788592611 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592595.614767:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6684:1875475147283456:0@lo:700: 40000000:02000000:0.0:1788592595.614787:0:6684:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1788592595.697747:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788592595.697773:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1788592595.697952:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8058:x1875475147283328:12345-0@lo:700: Request processed in 151393us (151499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592595.697968:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592595.698159:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba576a00 x1875475147283328/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788592611 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.698173:0:8058:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788592595.698194:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283328:0@lo:700: 00000100:00100000:1.0:1788592595.711135:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147283584:0@lo:13: 00000100:00100000:1.0:1788592595.711229:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592595.711329:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283584 00000100:00100000:1.0:1788592595.711338:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283584 00000100:00100000:1.0:1788592595.711420:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788592595.711432:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147283584:12345-0@lo:13: 00002000:00000024:1.0:1788592595.711471:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592595.711527:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147283584:12345-0@lo:13: Request processed in 97us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592595.711534:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788592595.711599:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba574a80 x1875475147283584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592595.711622:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147283584:0@lo:13: 00000004:02000040:2.0:1788592595.720687:0:8058:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1788592595.727490:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283712:0@lo:5: 00000100:00100000:3.0:1788592595.727635:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592595.727700:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185e8e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592595.727792:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283712 00000100:00100000:1.0:1788592595.727802:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283712 00000100:00100000:1.0:1788592595.727870:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592595.727883:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8058:x1875475147283712:12345-0@lo:5: 00002000:00080000:2.0:1788592595.735942:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788592595.735969:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788592595.741875:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8058:x1875475147283712:12345-0@lo:5: Request processed in 13981us (14227us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788592595.741895:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788592595.742104:0:8058:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898183e99880 x1875475147283712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788592611 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592595.742127:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8058:1875475147283712:0@lo:5: 00000004:00080000:2.0:1788592595.742147:0:8058:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788592596.222640:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592597.258101:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592598.271598:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592599.298261:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788592599.304128:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788592599.967137:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592599.968052:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774272 00000100:00100000:1.0:1788592599.968085:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774272 00000100:00100000:1.0:1788592599.968151:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:1.0:1788592599.968162:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2340:x1875475136774272:12345-192.168.204.20@tcp:250: 00010000:00080000:1.0:1788592599.968196:0:5815:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a743afaf-efea-4d20-b19b-8e962ea96cca@192.168.204.20@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1788592599.968230:0:5815:0:(genops.c:1385:class_connect()) connect: client a743afaf-efea-4d20-b19b-8e962ea96cca, cookie 0x27b316f1325109a6 00000100:00080000:1.0:1788592599.968471:0:5815:0:(import.c:65:import_set_state_nolock()) ffff898084bc7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592599.968553:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+5:2340:x1875475136774272:12345-192.168.204.20@tcp:250: Request processed in 391us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592599.968563:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:0.0:1788592599.976245:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592599.976501:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774400 00000100:00100000:0.0:1788592599.976515:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774400 00000100:00100000:0.0:1788592599.976585:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1788592599.976597:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+5:5571:x1875475136774400:12345-192.168.204.20@tcp:101: 00010000:00010000:0.0:1788592599.976618:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592599.976640:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d188a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592599.976677:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592599.976713:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 6 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592599.976724:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fc00, rc 0) 00000100:00100000:0.0:1788592599.976788:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+6:5571:x1875475136774400:12345-192.168.204.20@tcp:101: Request processed in 192us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592599.976795:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:0.0:1788592600.001559:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.001693:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774528 00000100:00100000:3.0:1788592600.001707:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774528 00000100:00100000:3.0:1788592600.001789:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1788592600.001801:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+6:5571:x1875475136774528:12345-192.168.204.20@tcp:501: 00000100:00100000:3.0:1788592600.002237:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+6:5571:x1875475136774528:12345-192.168.204.20@tcp:501: Request processed in 437us (690us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592600.002246:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:2.0:1788592600.008556:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592600.008619:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774656 00000100:00100000:2.0:1788592600.008631:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774656 00000100:00100000:2.0:1788592600.008698:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:2.0:1788592600.008708:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+6:5571:x1875475136774656:12345-192.168.204.20@tcp:101: 00010000:00010000:2.0:1788592600.008729:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592600.008750:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1891 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.008815:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.008827:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.008836:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4800, rc 0) 00000100:00100000:2.0:1788592600.008905:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+7:5571:x1875475136774656:12345-192.168.204.20@tcp:101: Request processed in 198us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.008913:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:0.0:1788592600.015468:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592600.015537:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774784 00000100:00100000:1.0:1788592600.015550:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774784 00000100:00100000:1.0:1788592600.015619:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:1.0:1788592600.015631:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+7:5571:x1875475136774784:12345-192.168.204.20@tcp:501: 00000100:00100000:1.0:1788592600.016026:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5571:x1875475136774784:12345-192.168.204.20@tcp:501: Request processed in 396us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.016036:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:2.0:1788592600.023447:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.023547:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136774912 00000100:00100000:3.0:1788592600.023559:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136774912 00000100:00100000:3.0:1788592600.023623:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1788592600.023640:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5571:x1875475136774912:12345-192.168.204.20@tcp:503: 00000100:00100000:3.0:1788592600.024088:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5571:x1875475136774912:12345-192.168.204.20@tcp:503: Request processed in 453us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592600.024096:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:0.0:1788592600.033617:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.033831:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775040 00000100:00100000:3.0:1788592600.033843:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775040 00000100:00100000:3.0:1788592600.033911:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:3.0:1788592600.033933:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5589:x1875475136775040:12345-192.168.204.20@tcp:502: 00000100:00100000:2.0:1788592600.035766:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5589:x1875475136775040:12345-192.168.204.20@tcp:502: Request processed in 1833us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.035782:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:3.0:1788592600.073194:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.073240:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775168 00000100:00100000:3.0:1788592600.073281:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775168 00000100:00100000:3.0:1788592600.073377:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:3.0:1788592600.073389:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5589:x1875475136775168:12345-192.168.204.20@tcp:502: 00000100:00100000:3.0:1788592600.073766:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5589:x1875475136775168:12345-192.168.204.20@tcp:502: Request processed in 379us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592600.073775:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:0.0:1788592600.085260:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592600.085390:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775296 00000100:00100000:2.0:1788592600.085404:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775296 00000100:00100000:2.0:1788592600.085478:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1788592600.085491:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5571:x1875475136775296:12345-192.168.204.20@tcp:101: 00010000:00010000:2.0:1788592600.085512:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592600.085536:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4c00/0x27b316f1325109bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d18bb expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.085572:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4c00/0x27b316f1325109bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18bb expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.085587:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4c00/0x27b316f1325109bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18bb expref: 9 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592600.085620:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4c00, rc 0) 00000100:00100000:2.0:1788592600.085709:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5571:x1875475136775296:12345-192.168.204.20@tcp:101: Request processed in 220us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.085716:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1788592600.094467:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.094786:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775424 00000100:00100000:3.0:1788592600.094799:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775424 00000100:00100000:3.0:1788592600.094865:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:3.0:1788592600.094877:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5571:x1875475136775424:12345-192.168.204.20@tcp:256: 20000000:01000000:3.0:1788592600.094909:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788592600.094939:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788592600.094943:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788592600.094946:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788592600.094948:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788592600.109996:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5571:x1875475136775424:12345-192.168.204.20@tcp:256: Request processed in 15109us (15528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.110015:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1788592600.118032:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.118195:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775552 00000100:00100000:0.0:1788592600.118209:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775552 00000100:00100000:0.0:1788592600.118519:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:0.0:1788592600.118532:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5571:x1875475136775552:12345-192.168.204.20@tcp:101: 00010000:00010000:0.0:1788592600.118553:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592600.118576:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d18c2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592600.118611:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592600.118625:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 10 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592600.118744:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:0.0:1788592600.118818:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5571:x1875475136775552:12345-192.168.204.20@tcp:101: Request processed in 290us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.118841:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:0.0:1788592600.121727:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592600.124057:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775680 00000100:00100000:2.0:1788592600.124076:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775680 00000100:00100000:2.0:1788592600.124154:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:2.0:1788592600.124166:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5571:x1875475136775680:12345-192.168.204.20@tcp:501: 00000100:00100000:2.0:1788592600.125719:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5571:x1875475136775680:12345-192.168.204.20@tcp:501: Request processed in 1545us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.125734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:1.0:1788592600.139894:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592600.139958:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775808 00000100:00100000:1.0:1788592600.139971:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775808 00000100:00100000:1.0:1788592600.142657:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:1.0:1788592600.142676:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5571:x1875475136775808:12345-192.168.204.20@tcp:503: 00000100:00100000:1.0:1788592600.143437:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5571:x1875475136775808:12345-192.168.204.20@tcp:503: Request processed in 759us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.143461:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1788592600.158856:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.159601:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136775936 00000100:00100000:0.0:1788592600.159615:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136775936 00000100:00100000:0.0:1788592600.159681:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:0.0:1788592600.159693:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5593:x1875475136775936:12345-192.168.204.20@tcp:502: 00000100:00100000:0.0:1788592600.160123:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5593:x1875475136775936:12345-192.168.204.20@tcp:502: Request processed in 431us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.160131:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:2.0:1788592600.174053:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592600.174860:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776064 00000100:00100000:1.0:1788592600.174877:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776064 00000100:00100000:1.0:1788592600.175013:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:1.0:1788592600.175024:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5593:x1875475136776064:12345-192.168.204.20@tcp:502: 00000100:00100000:1.0:1788592600.176871:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5593:x1875475136776064:12345-192.168.204.20@tcp:502: Request processed in 1024us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.176889:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1788592600.181878:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592600.182161:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776192 00000100:00100000:2.0:1788592600.182174:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776192 00000100:00100000:2.0:1788592600.182245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1788592600.182255:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1875475136776192:12345-192.168.204.20@tcp:38: 00010000:00080000:2.0:1788592600.182293:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:2.0:1788592600.182417:0:5822:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f1325109c9 00000004:00100000:2.0:1788592600.182679:0:5822:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1788592600.182690:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788592600.290567:0:5822:0:(import.c:65:import_set_state_nolock()) ffff898084ac9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592600.290672:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136776192:12345-192.168.204.20@tcp:38: Request processed in 108414us (108808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.290711:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:2.0:1788592600.319835:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592600.795322:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592600.795428:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.795549:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776320 00000100:00100000:0.0:1788592600.795562:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776320 00000100:00100000:0.0:1788592600.795657:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776448 00000100:00100000:0.0:1788592600.795660:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776448 00000100:00100000:0.0:1788592600.795683:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1788592600.795695:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:0:x1875475136776320:12345-192.168.204.20@tcp:41: 00000004:00000024:0.0:1788592600.795754:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788592600.795829:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:0:x1875475136776320:12345-192.168.204.20@tcp:41: Request processed in 136us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.795837:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1788592600.795858:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1788592600.795865:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776448:12345-192.168.204.20@tcp:41: 00000004:00000024:0.0:1788592600.795878:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788592600.795899:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776448:12345-192.168.204.20@tcp:41: Request processed in 34us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.795936:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:3.0:1788592600.796464:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592600.798576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.798734:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776576 00000100:00100000:0.0:1788592600.798746:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776576 00000100:00100000:0.0:1788592600.798815:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1788592600.798827:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776576:12345-192.168.204.20@tcp:40: 00000100:00100000:0.0:1788592600.799127:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776576:12345-192.168.204.20@tcp:40: Request processed in 301us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.799137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1788592600.806811:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.806919:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592600.806974:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592600.807321:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776704 00000100:00100000:1.0:1788592600.807334:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776704 00000100:00100000:1.0:1788592600.807414:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776832 00000100:00100000:1.0:1788592600.807418:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776832 00000100:00100000:1.0:1788592600.807435:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592600.807446:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875475136776704:12345-192.168.204.20@tcp:8: 00010000:00080000:1.0:1788592600.807485:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1788592600.807525:0:6678:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f1325109d0 00002000:00100000:1.0:1788592600.807539:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 551ef727-4fdd-447b-98b8-d223b2dddab7/ffff898084bc0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592600.807567:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788592600.807964:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788592600.808007:0:6678:0:(import.c:65:import_set_state_nolock()) ffff898084bc4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592600.808093:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136776704:12345-192.168.204.20@tcp:8: Request processed in 646us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.808101:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592600.808130:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592600.808153:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2340:x1875475136776832:12345-192.168.204.20@tcp:8: 00010000:00080000:1.0:1788592600.808172:0:6678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1788592600.808191:0:6678:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f1325109d7 00002000:00100000:1.0:1788592600.808197:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 551ef727-4fdd-447b-98b8-d223b2dddab7/ffff898084bc6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592600.808214:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788592600.808497:0:6678:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788592600.808517:0:6678:0:(import.c:65:import_set_state_nolock()) ffff898084bc1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592600.808546:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136776832:12345-192.168.204.20@tcp:8: Request processed in 393us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.808554:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1788592600.809333:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136776960 00000100:00100000:3.0:1788592600.809420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136776960 00000100:00100000:3.0:1788592600.809517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1788592600.809528:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776960:12345-192.168.204.20@tcp:33: 00000100:00100000:2.0:1788592600.830747:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147283840:0@lo:13: 00000100:00100000:2.0:1788592600.830827:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592600.831045:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147284352:0@lo:400: 00000100:00100000:2.0:1788592600.831077:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592600.831098:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592600.831105:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147284224:0@lo:400: 00000100:00100000:2.0:1788592600.831130:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592600.831132:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283840 00000100:00100000:1.0:1788592600.831142:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283840 00000100:00100000:2.0:1788592600.831155:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284352 00000100:00100000:2.0:1788592600.831158:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284352 00000100:00100000:2.0:1788592600.831197:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284224 00000100:00100000:2.0:1788592600.831200:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284224 00000100:00100000:1.0:1788592600.831202:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788592600.831212:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147283840:12345-0@lo:13: 00000100:00100000:2.0:1788592600.831217:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592600.831223:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147284352:12345-0@lo:400: 00000100:00100000:2.0:1788592600.831276:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147284352:12345-0@lo:400: Request processed in 52us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.831284:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788592600.831302:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788592600.831309:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147284224:12345-0@lo:400: 00000100:00100000:2.0:1788592600.831596:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147284224:12345-0@lo:400: Request processed in 287us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592600.831603:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788592600.831649:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085893480 x1875475147284224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592600.831664:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147284224:0@lo:400: 00010000:00080000:2.0:1788592600.831688:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085892a00 x1875475147284352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592600.831697:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147284352:0@lo:400: 00002000:00000024:1.0:1788592600.832506:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592600.832584:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147283840:12345-0@lo:13: Request processed in 1370us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.832594:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788592600.832633:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592600.832640:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788592600.832677:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890000 x1875475147283840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592600.832698:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147283840:0@lo:13: 00000100:00100000:1.0:1788592600.832753:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147284096:0@lo:400: 00000100:00100000:1.0:1788592600.832790:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592600.832829:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147284608:0@lo:13: 00000100:00100000:1.0:1788592600.832854:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592600.832885:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788592600.832892:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147283968:0@lo:400: 00000100:00100000:1.0:1788592600.832921:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592600.832946:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147284480:0@lo:400: 00000100:00100000:1.0:1788592600.833083:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592600.833205:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147283968 00000100:00100000:1.0:1788592600.833213:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147283968 00000100:00100000:1.0:1788592600.833254:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788592600.833261:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147283968:12345-0@lo:400: 00000100:00100000:1.0:1788592600.833301:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147283968:12345-0@lo:400: Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.833308:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788592600.833385:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147283968:0@lo:400: 00000100:00100000:1.0:1788592600.833403:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284608 00000100:00100000:1.0:1788592600.833406:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284608 00000100:00100000:1.0:1788592600.833438:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592600.833444:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147284608:12345-0@lo:13: 00002000:00000024:1.0:1788592600.833459:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592600.833491:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147284608:12345-0@lo:13: Request processed in 47us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.833497:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788592600.833512:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788592600.833531:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898184e59500 x1875475147284608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592600.833540:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788592600.833563:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147284608:0@lo:13: 00000100:00100000:1.0:1788592600.833585:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284480 00000100:00100000:1.0:1788592600.833589:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284480 00000100:00100000:1.0:1788592600.833616:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592600.833623:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147284480:12345-0@lo:400: 00000100:00100000:1.0:1788592600.833659:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147284480:12345-0@lo:400: Request processed in 37us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.833666:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788592600.833690:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085891c00 x1875475147284480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592600.833700:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147284480:0@lo:400: 00000100:00100000:1.0:1788592600.833732:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284096 00000100:00100000:1.0:1788592600.833736:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284096 00000100:00100000:1.0:1788592600.833763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592600.833770:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147284096:12345-0@lo:400: 00000100:00100000:1.0:1788592600.833805:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147284096:12345-0@lo:400: Request processed in 35us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592600.833811:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788592600.833836:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085890e00 x1875475147284096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592600.833844:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147284096:0@lo:400: 00000004:00080000:3.0:1788592600.835612:0:5825:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 26008us 00000004:00200000:0.0:1788592600.859297:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788592600.861902:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5571:x1875475136776960:12345-192.168.204.20@tcp:33: Request processed in 52363us (55090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592600.862762:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000001:00100000:1.0:1788592600.916004:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000100:00100000:0.0:1788592601.106659:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592601.106883:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777088 00000100:00100000:2.0:1788592601.106895:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777088 00000100:00100000:2.0:1788592601.107757:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1788592601.107775:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5611:x1875475136777088:12345-192.168.204.20@tcp:101: 00010000:00010000:2.0:1788592601.107805:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592601.107845:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325109de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d18ec expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.107932:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.108109:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.108129:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592601.108737:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788592601.108744:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592601.108770:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.108805:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325109de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18ec expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.108830:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18ec expref: 7 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592601.108855:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592601.108858:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592601.108862:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5800, rc 0) 00000100:00100000:2.0:1788592601.109000:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:5611:x1875475136777088:12345-192.168.204.20@tcp:101: Request processed in 1230us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592601.109008:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00010000:00010000:0.0:1788592601.346656:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592602.366633:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592603.390839:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592603.648500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592603.648601:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777216 00000100:00100000:1.0:1788592603.648613:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777216 00000100:00100000:1.0:1788592603.648710:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592603.648723:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:5663:x1875475136777216:12345-192.168.204.20@tcp:41: 00000004:00000024:1.0:1788592603.648804:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:2.0:1788592603.649035:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592603.649158:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:5663:x1875475136777216:12345-192.168.204.20@tcp:41: Request processed in 436us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592603.649167:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592603.657081:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592603.657202:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777344 00000100:00100000:2.0:1788592603.657214:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777344 00000100:00100000:2.0:1788592603.657319:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1788592603.657332:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:551ef727-4fdd-447b-98b8-d223b2dddab7+5:5663:x1875475136777344:12345-192.168.204.20@tcp:13: 00002000:00000024:2.0:1788592603.657414:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592603.657492:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:551ef727-4fdd-447b-98b8-d223b2dddab7+5:5663:x1875475136777344:12345-192.168.204.20@tcp:13: Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592603.657500:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1788592603.660486:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592603.663016:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777472 00000100:00100000:2.0:1788592603.663033:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777472 00000100:00100000:2.0:1788592603.663138:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592603.663151:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5663:x1875475136777472:12345-192.168.204.20@tcp:13: 00002000:00000024:2.0:1788592603.663202:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592603.663312:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:551ef727-4fdd-447b-98b8-d223b2dddab7+6:5663:x1875475136777472:12345-192.168.204.20@tcp:13: Request processed in 164us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592603.663320:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00080000:1.0:1788592603.664132:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592603.664139:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788592604.418012:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592605.441102:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592605.497513:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000001:00100000:3.0:1788592605.505841:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000100:00100000:1.0:1788592605.951444:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147284736:0@lo:13: 00000100:00100000:1.0:1788592605.951539:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592605.951753:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592605.951778:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147284864:0@lo:13: 00000100:00100000:3.0:1788592605.951813:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592605.951860:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284736 00000100:00100000:3.0:1788592605.951869:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284736 00000100:00100000:3.0:1788592605.955407:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284864 00000100:00100000:3.0:1788592605.955426:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284864 00000100:00100000:3.0:1788592605.955478:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592605.955492:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147284736:12345-0@lo:13: 00002000:00000024:3.0:1788592605.955546:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592605.955673:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147284736:12345-0@lo:13: Request processed in 184us (4133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592605.955681:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592605.955700:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592605.955708:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147284864:12345-0@lo:13: 00002000:00000024:3.0:1788592605.955732:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592605.955767:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147284864:12345-0@lo:13: Request processed in 60us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592605.955773:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788592605.955798:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592605.955803:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592605.956192:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147284992:0@lo:400: 00000100:00100000:2.0:1788592605.956255:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592605.956299:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592605.956304:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147285120:0@lo:400: 00000100:00100000:2.0:1788592605.956331:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592605.956393:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147285120 00000100:00100000:2.0:1788592605.956398:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147285120 00000100:00100000:2.0:1788592605.956436:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592605.956443:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147285120:12345-0@lo:400: 00000100:00100000:2.0:1788592605.956482:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147285120:12345-0@lo:400: Request processed in 39us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592605.956488:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592605.956533:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147285120:0@lo:400: 00000100:00100000:2.0:1788592605.956559:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147285376:0@lo:400: 00000100:00100000:2.0:1788592605.956583:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592605.956603:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592605.956609:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147285248:0@lo:400: 00000100:00100000:2.0:1788592605.956630:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592605.956653:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147285376 00000100:00100000:2.0:1788592605.956657:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147285376 00000100:00100000:2.0:1788592605.956685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147285248 00000100:00100000:2.0:1788592605.956688:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147285248 00000100:00100000:2.0:1788592605.956708:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788592605.956714:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147285376:12345-0@lo:400: 00000100:00100000:2.0:1788592605.956747:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147285376:12345-0@lo:400: Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592605.956753:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788592605.956781:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592605.956785:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147285248:12345-0@lo:400: 00000100:00100000:2.0:1788592605.956810:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147285248:12345-0@lo:400: Request processed in 24us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592605.956814:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592605.956838:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147285248:0@lo:400: 00000100:00100000:2.0:1788592605.956845:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147285376:0@lo:400: 00000100:00080000:3.0:1788592605.958130:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592605.959166:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147284992 00000100:00100000:1.0:1788592605.959181:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147284992 00000100:00100000:1.0:1788592605.959257:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788592605.959268:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147284992:12345-0@lo:400: 00000100:00100000:1.0:1788592605.959411:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147284992:12345-0@lo:400: Request processed in 145us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592605.959420:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:1.0:1788592605.959501:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898183e99500 x1875475147284864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592605.959528:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147284864:0@lo:13: 00010000:00080000:1.0:1788592605.959547:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981ba576a00 x1875475147284736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592605.959560:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147284736:0@lo:13: 00000100:00100000:2.0:1788592605.959808:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147284992:0@lo:400: 00000100:00100000:1.0:1788592606.206218:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592606.206275:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592606.206336:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592606.206403:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592606.206460:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777856 00000100:00100000:1.0:1788592606.206474:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777856 00000100:00100000:1.0:1788592606.206554:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777984 00000100:00100000:1.0:1788592606.206558:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777984 00000100:00100000:1.0:1788592606.206578:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592606.206590:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136777856:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1788592606.206676:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136777856:12345-192.168.204.20@tcp:400: Request processed in 89us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592606.206683:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592606.206706:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592606.206712:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136777984:12345-192.168.204.20@tcp:400: 00000100:00100000:1.0:1788592606.206735:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136777984:12345-192.168.204.20@tcp:400: Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592606.206740:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1788592606.207465:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777600 00000100:00100000:2.0:1788592606.207473:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777600 00000100:00100000:2.0:1788592606.207515:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:2.0:1788592606.207523:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136777600:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1788592606.207568:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136777600:12345-192.168.204.20@tcp:400: Request processed in 46us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592606.207575:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:2.0:1788592606.207611:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136777728 00000100:00100000:2.0:1788592606.207614:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136777728 00000100:00100000:2.0:1788592606.207659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:2.0:1788592606.207666:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136777728:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1788592606.207694:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136777728:12345-192.168.204.20@tcp:400: Request processed in 29us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592606.207700:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00080000:2.0:1788592606.207772:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592606.207777:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592606.207780:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788592606.299570:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788592606.462813:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592607.486532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592608.510745:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592609.535458:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788592609.935463:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe342d4800 20000000:00000080:0.0:1788592609.935488:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89808658c000 uarg=0000000000000000 20000000:01000000:0.0:1788592609.935543:0:8433:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788592609.935545:0:8433:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788592609.935549:0:8433:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788592609.935555:0:8433:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788592609.935568:0:8433:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788592609.935584:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788592609.935587:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788592609.935922:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788592609.935925:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788592609.937931:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788592609.939910:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788592609.939981:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788592609.940037:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788592609.940054:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788592609.940056:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788592609.941571:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788592609.942115:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788592609.942204:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788592609.942244:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788592609.942257:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788592609.942260:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788592609.943123:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788592609.943615:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788592609.943662:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788592609.943694:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788592609.943710:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788592609.943712:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788592609.944620:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788592609.945090:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788592609.945172:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788592609.945214:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788592609.945230:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788592609.945255:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945277:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108e2 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945286:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251090c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945294:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510936 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945301:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510944 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945308:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510952 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945316:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945334:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510998 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945346:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945636:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945645:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945696:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945714:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 9 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.945733:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285504:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592609.945986:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.945995:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946005:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285632:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592609.946039:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510998 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946062:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510998 expref: 18 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946072:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285760:0@lo:104: 00000100:00100000:0.0:1788592609.946150:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592609.946198:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946207:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946215:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193beea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285888:0@lo:104: 00000100:00100000:0.0:1788592609.946243:0:8433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592609.946280:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510952 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946289:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510952 expref: 18 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946298:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286016:0@lo:104: 00010000:00010000:0.0:1788592609.946325:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510944 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946335:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510944 expref: 18 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946343:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286144:0@lo:104: 00010000:00010000:0.0:1788592609.946396:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510936 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946411:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510936 expref: 18 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946420:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286272:0@lo:104: 00010000:00010000:0.0:1788592609.946450:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f13251090c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946457:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f13251090c expref: 18 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946465:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286400:0@lo:104: 00010000:00010000:0.0:1788592609.946489:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 18 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.946497:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 18 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.946504:0:8433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286528:0@lo:104: 00000100:00100000:0.0:1788592609.946523:0:8433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981885a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592609.946615:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788592609.946637:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.946651:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.946660:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.946667:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.946689:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.946707:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147285760 00000100:00100000:3.0:1788592609.946714:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147285760 00000100:00100000:3.0:1788592609.946770:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147285888 00000100:00100000:3.0:1788592609.946773:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147285888 00000100:00100000:3.0:1788592609.946784:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286016 00000100:00100000:3.0:1788592609.946786:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286016 00000100:00100000:3.0:1788592609.946795:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286144 00000100:00100000:3.0:1788592609.946798:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286144 00000100:00100000:3.0:1788592609.946807:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286272 00000100:00100000:3.0:1788592609.946809:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286272 00000100:00100000:3.0:1788592609.946817:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286400 00000100:00100000:3.0:1788592609.946819:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286400 00000100:00100000:3.0:1788592609.946827:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286528 00000100:00100000:3.0:1788592609.946829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286528 00000100:00100000:3.0:1788592609.946841:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592609.946850:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:8433:x1875475147285760:12345-0@lo:104: 00010000:00010000:3.0:1788592609.946864:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.946931:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592609.946938:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+9:8433:x1875475147285760:12345-0@lo:104: Request processed in 89us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.946946:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592609.946964:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592609.946971:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+8:8433:x1875475147285888:12345-0@lo:104: 00010000:00010000:3.0:1788592609.946980:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947013:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592609.947018:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085d4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+8:8433:x1875475147285888:12345-0@lo:104: Request processed in 49us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947034:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592609.947071:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592609.947077:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+7:8433:x1875475147286016:12345-0@lo:104: 00010000:00010000:3.0:1788592609.947086:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947112:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788592609.947117:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+7:8433:x1875475147286016:12345-0@lo:104: Request processed in 41us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947123:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592609.947135:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592609.947150:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:8433:x1875475147286144:12345-0@lo:104: 00010000:00010000:3.0:1788592609.947159:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947186:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788592609.947191:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+6:8433:x1875475147286144:12345-0@lo:104: Request processed in 43us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947197:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592609.947210:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592609.947215:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:8433:x1875475147286272:12345-0@lo:104: 00010000:00010000:3.0:1788592609.947223:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947259:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788592609.947266:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:8433:x1875475147286272:12345-0@lo:104: Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947277:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592609.947290:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592609.947295:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:8433:x1875475147286400:12345-0@lo:104: 00010000:00010000:3.0:1788592609.947303:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947330:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788592609.947335:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:8433:x1875475147286400:12345-0@lo:104: Request processed in 40us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947341:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592609.947381:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592609.947387:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:8433:x1875475147286528:12345-0@lo:104: 00010000:00010000:3.0:1788592609.947395:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947422:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788592609.947427:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:8433:x1875475147286528:12345-0@lo:104: Request processed in 41us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.947432:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788592609.947453:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788592609.947460:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947468:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947473:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947493:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947502:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947508:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947544:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947551:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.947573:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947581:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762ea00/0x27b316f132510998 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251099f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947600:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788592609.947604:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947610:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9c00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947613:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947620:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947627:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947638:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947653:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947660:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.947665:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947672:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f13251096e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510975 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947682:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788592609.947686:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947692:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5c00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947695:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947702:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947708:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947714:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947724:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947730:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.947753:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947760:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c5c00/0x27b316f132510952 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510959 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947770:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788592609.947773:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947780:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813df200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947783:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947790:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947797:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947802:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947816:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947841:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.947846:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947853:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813df200/0x27b316f132510944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251094b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947866:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788592609.947874:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947881:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947884:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947891:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947897:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947903:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947917:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947923:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.947927:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947934:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251093d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947944:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592609.947948:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947954:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5e00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.947957:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.947974:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.947980:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.947986:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.947999:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948006:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.948010:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948017:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c5e00/0x27b316f13251090c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510913 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948026:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592609.948029:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948034:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dfc00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592609.948037:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948044:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592609.948050:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592609.948061:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592609.948077:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948083:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592609.948087:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948093:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f1325108e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325108e9 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948108:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592609.948110:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592609.948112:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592609.948121:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592609.948150:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147286656:0@lo:103: 00000100:00100000:3.0:1788592609.948195:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948232:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147287168:0@lo:103: 00000100:00100000:3.0:1788592609.948254:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948275:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788592609.948280:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147286784:0@lo:103: 00000100:00100000:3.0:1788592609.948303:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948323:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147287296:0@lo:103: 00000100:00100000:3.0:1788592609.948341:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948381:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147286912:0@lo:103: 00000100:00100000:3.0:1788592609.948406:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948425:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147287424:0@lo:103: 00000100:00100000:3.0:1788592609.948446:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948459:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592609.948463:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147287040:0@lo:103: 00000100:00100000:3.0:1788592609.948482:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592609.948605:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286656 00000100:00100000:3.0:1788592609.948611:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286656 00010000:00010000:3.0:1788592609.948637:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510998 expref: 19 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948657:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287168 00000100:00100000:3.0:1788592609.948660:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287168 00010000:00010000:3.0:1788592609.948670:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510936 expref: 20 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948679:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286784 00000100:00100000:3.0:1788592609.948681:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286784 00010000:00010000:3.0:1788592609.948690:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251096e expref: 21 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948699:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287296 00000100:00100000:3.0:1788592609.948701:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287296 00010000:00010000:3.0:1788592609.948711:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251090c expref: 22 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948720:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147286912 00000100:00100000:3.0:1788592609.948723:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147286912 00010000:00010000:3.0:1788592609.948733:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510952 expref: 23 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948742:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287424 00000100:00100000:3.0:1788592609.948745:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287424 00010000:00010000:3.0:1788592609.948764:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 24 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948776:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287040 00000100:00100000:3.0:1788592609.948779:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287040 00010000:00010000:3.0:1788592609.948789:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510944 expref: 25 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592609.948801:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592609.948809:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+25:3285:x1875475147286656:12345-0@lo:103: 00010000:00010000:3.0:1788592609.948821:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.948827:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510998 expref: 25 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948836:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510998 expref: 25 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948855:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.948891:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+25:3285:x1875475147286656:12345-0@lo:103: Request processed in 82us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.948898:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592609.948913:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592609.948919:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+24:3285:x1875475147287168:12345-0@lo:103: 00010000:00010000:3.0:1788592609.948928:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.948932:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510936 expref: 24 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948941:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510936 expref: 24 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.948961:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.948985:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+24:3285:x1875475147287168:12345-0@lo:103: Request processed in 66us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.948991:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592609.949004:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592609.949009:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+23:3285:x1875475147286784:12345-0@lo:103: 00010000:00010000:3.0:1788592609.949017:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.949022:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251096e expref: 23 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949030:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f13251096e expref: 23 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949040:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.949062:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+23:3285:x1875475147286784:12345-0@lo:103: Request processed in 53us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.949068:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592609.949081:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592609.949086:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+22:3285:x1875475147287296:12345-0@lo:103: 00010000:00010000:3.0:1788592609.949094:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.949098:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f13251090c expref: 22 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949106:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f13251090c expref: 22 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949116:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.949158:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+22:3285:x1875475147287296:12345-0@lo:103: Request processed in 72us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.949164:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592609.949178:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592609.949184:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+21:3283:x1875475147286912:12345-0@lo:103: 00010000:00010000:3.0:1788592609.949191:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.949195:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510952 expref: 21 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949203:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510952 expref: 21 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949212:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.949237:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+21:3283:x1875475147286912:12345-0@lo:103: Request processed in 54us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.949244:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592609.949256:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592609.949261:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+20:3283:x1875475147287424:12345-0@lo:103: 00010000:00010000:3.0:1788592609.949268:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.949272:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 20 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949280:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 20 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949289:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592609.949308:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+20:3283:x1875475147287424:12345-0@lo:103: Request processed in 47us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.949314:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592609.949333:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592609.949339:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147287040:12345-0@lo:103: 00010000:00010000:3.0:1788592609.949370:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592609.949375:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510944 expref: 19 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949383:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510944 expref: 19 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592609.949391:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592609.949696:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e200/0x27b316f13251099f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510998 expref: 19 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949713:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285760:0@lo:104: 00010000:00010000:0.0:1788592609.949728:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813de800/0x27b316f132510975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f13251096e expref: 18 pid: 5817 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949745:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193beea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285888:0@lo:104: 00010000:00010000:0.0:1788592609.949756:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dfa00/0x27b316f132510959 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510952 expref: 17 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949777:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bedc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286016:0@lo:104: 00010000:00010000:0.0:1788592609.949791:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c4000/0x27b316f13251094b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510944 expref: 16 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949800:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286144:0@lo:104: 00010000:00010000:0.0:1788592609.949809:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e800/0x27b316f13251093d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510936 expref: 15 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949817:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286272:0@lo:104: 00010000:00010000:0.0:1788592609.949826:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fa00/0x27b316f132510913 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f13251090c expref: 14 pid: 5815 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949834:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286400:0@lo:104: 00010000:00010000:0.0:1788592609.949842:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e000/0x27b316f1325108e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f1325108e2 expref: 13 pid: 5818 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.949850:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193beca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147286528:0@lo:104: 00000100:00100000:3.0:1788592609.950173:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3283:x1875475147287040:12345-0@lo:103: Request processed in 832us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592609.950181:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592609.950253:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147287040:0@lo:103: 00000100:00100000:3.0:1788592609.950265:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147286912:0@lo:103: 00000100:00100000:3.0:1788592609.950273:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147287424:0@lo:103: 00000100:00100000:3.0:1788592609.950310:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147286784:0@lo:103: 00000100:00100000:3.0:1788592609.950320:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147287296:0@lo:103: 00000100:00100000:3.0:1788592609.950329:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147286656:0@lo:103: 00000100:00100000:3.0:1788592609.950338:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147287168:0@lo:103: 00000100:00100000:2.0:1788592609.952203:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592609.952225:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285504:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592609.952242:0:8433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1875475147285632:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592609.952307:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.952419:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778112 00000100:00100000:0.0:1788592609.952427:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778112 00010000:00010000:0.0:1788592609.952464:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 10 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592609.952500:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1788592609.952509:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2343:x1875475136778112:12345-192.168.204.20@tcp:103: 00010000:00010000:0.0:1788592609.952523:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592609.952529:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 10 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.952549:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 10 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.952570:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4800/0x27b316f1325109b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1891 expref: 10 pid: 5815 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592609.952586:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592609.952643:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:2343:x1875475136778112:12345-192.168.204.20@tcp:103: Request processed in 134us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592609.952651:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1788592609.952814:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592609.952871:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778240 00000100:00100000:1.0:1788592609.952877:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778240 00010000:00010000:1.0:1788592609.952899:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592609.952930:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:1.0:1788592609.952939:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:2343:x1875475136778240:12345-192.168.204.20@tcp:103: 00010000:00010000:1.0:1788592609.952950:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592609.952955:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.952966:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.952976:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fc00/0x27b316f1325109ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d188a expref: 9 pid: 5818 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.952990:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953005:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953021:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953028:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953043:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953051:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953057:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592609.953062:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953071:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953097:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953107:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592609.953131:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+8:2343:x1875475136778240:12345-192.168.204.20@tcp:103: Request processed in 194us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592609.953149:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00010000:00010000:1.0:1788592609.953177:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953184:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592609.953190:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e400/0x27b316f1325109ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592610.558596:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592611.072834:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147287680:0@lo:13: 00000100:00100000:1.0:1788592611.072867:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147287552:0@lo:400: 00000100:00100000:3.0:1788592611.072940:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.072940:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.073237:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147288064:0@lo:400: 00000100:00100000:1.0:1788592611.073264:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.073298:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592611.073305:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147287936:0@lo:400: 00000100:00100000:1.0:1788592611.073330:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.073691:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147287808:0@lo:400: 00000100:00100000:2.0:1788592611.073727:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.073749:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147288320:0@lo:400: 00000100:00100000:2.0:1788592611.073772:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.073792:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592611.073797:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147288192:0@lo:400: 00000100:00100000:2.0:1788592611.073817:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.073847:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287936 00000100:00100000:2.0:1788592611.073856:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287936 00000100:00100000:2.0:1788592611.073914:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287808 00000100:00100000:2.0:1788592611.073917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287808 00000100:00100000:2.0:1788592611.073930:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288192 00000100:00100000:2.0:1788592611.073933:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288192 00000100:00100000:2.0:1788592611.073948:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592611.073957:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147287936:12345-0@lo:400: 00000100:00100000:1.0:1788592611.074181:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147288448:0@lo:13: 00000100:00100000:1.0:1788592611.074211:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.074248:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287552 00000100:00100000:1.0:1788592611.074253:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287552 00000100:00100000:1.0:1788592611.074283:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592611.074290:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3284:x1875475147287552:12345-0@lo:400: 00000100:00100000:1.0:1788592611.074333:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:3284:x1875475147287552:12345-0@lo:400: Request processed in 43us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.074340:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788592611.074406:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288064 00000100:00100000:1.0:1788592611.074411:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288064 00000100:00100000:1.0:1788592611.074441:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288320 00000100:00100000:1.0:1788592611.074444:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288320 00000100:00100000:1.0:1788592611.074459:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592611.074464:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147288064:12345-0@lo:400: 00000100:00100000:1.0:1788592611.074497:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147288064:12345-0@lo:400: Request processed in 32us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.074503:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592611.074515:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592611.074521:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147288320:12345-0@lo:400: 00000100:00100000:0.0:1788592611.075141:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147287552:0@lo:400: 00010000:00080000:0.0:1788592611.075160:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90f100 x1875475147288064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592611.075174:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147288064:0@lo:400: 00000100:00100000:0.0:1788592611.075989:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592611.076078:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147287808:12345-0@lo:400: 00000100:00100000:0.0:1788592611.076309:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147287808:12345-0@lo:400: Request processed in 242us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.076317:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592611.076418:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592611.076427:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147288192:12345-0@lo:400: 00000100:00100000:0.0:1788592611.076457:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147288192:12345-0@lo:400: Request processed in 33us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.076463:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592611.076630:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147287680 00000100:00100000:0.0:1788592611.076638:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147287680 00000100:00100000:0.0:1788592611.076668:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288448 00000100:00100000:0.0:1788592611.076670:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288448 00000100:00100000:0.0:1788592611.076714:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592611.076720:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147287680:12345-0@lo:13: 00002000:00000024:0.0:1788592611.076758:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592611.076790:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147287936:12345-0@lo:400: Request processed in 2833us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.076792:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147287680:12345-0@lo:13: Request processed in 73us (3857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.076798:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788592611.076798:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592611.076811:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592611.076818:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147288448:12345-0@lo:13: 00002000:00000024:0.0:1788592611.076837:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592611.076851:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147288192:0@lo:400: 00000100:00100000:2.0:1788592611.076864:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147287808:0@lo:400: 00000100:00100000:0.0:1788592611.076873:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147288448:12345-0@lo:13: Request processed in 56us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.076878:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592611.076895:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147287936:0@lo:400: 00000100:00080000:0.0:1788592611.076895:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592611.076900:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592611.076902:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788592611.076935:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898085893480 x1875475147288448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592611.076954:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147288448:0@lo:13: 00000100:00100000:1.0:1788592611.078279:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147288320:12345-0@lo:400: Request processed in 3747us (4495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.078305:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788592611.078433:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb249c00 x1875475147287680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592611.078469:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147287680:0@lo:13: 00010000:00080000:0.0:1788592611.078858:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90df80 x1875475147288320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592611.078871:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147288320:0@lo:400: 10000000:01000000:0.0:1788592611.264748:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592611.264762:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89819840e800 from 39 10000000:01000000:0.0:1788592611.264793:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592611.264868:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.264880:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.264891:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.264923:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288576:0@lo:101: 00000100:00100000:0.0:1788592611.265022:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.265157:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.268738:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288576 00000100:00100000:1.0:1788592611.268762:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288576 00000100:00100000:1.0:1788592611.268935:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788592611.268949:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+12:5820:x1875475147288576:12345-0@lo:101: 00010000:00010000:1.0:1788592611.268968:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592611.268991:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813de200/0x27b316f1325109fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f1325109f3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.269027:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813de200/0x27b316f1325109fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f1325109f3 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.269039:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813de200/0x27b316f1325109fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325109f3 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.269050:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813de200, rc 0) 00000100:00100000:1.0:1788592611.269624:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147288576:12345-0@lo:101: Request processed in 675us (4599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.269633:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788592611.269864:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288576:0@lo:101: 00010000:00010000:0.0:1788592611.269942:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.269955:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.270050:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288704:0@lo:501: 00000100:00100000:0.0:1788592611.270101:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.270292:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.270435:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288704 00000100:00100000:2.0:1788592611.270442:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288704 00000100:00100000:2.0:1788592611.270550:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788592611.270560:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147288704:12345-0@lo:501: 00000100:00100000:2.0:1788592611.271157:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147288704:12345-0@lo:501: Request processed in 588us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.271168:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788592611.276987:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288704:0@lo:501: 00000100:00100000:0.0:1788592611.278619:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288832:0@lo:503: 00000100:00100000:0.0:1788592611.278978:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.279010:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288832 00000100:00100000:0.0:1788592611.279020:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.279021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288832 00000100:00100000:1.0:1788592611.279096:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788592611.279108:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147288832:12345-0@lo:503: 00000100:00100000:1.0:1788592611.279421:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147288832:12345-0@lo:503: Request processed in 314us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.279430:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788592611.279693:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147288832:0@lo:503: 00000100:00100000:3.0:1788592611.280416:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8453:1875475147288960:0@lo:502: 00000100:00100000:3.0:1788592611.280486:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592611.280535:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.280615:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147288960 00000100:00100000:2.0:1788592611.280622:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147288960 00000100:00100000:2.0:1788592611.280679:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788592611.280689:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:8453:x1875475147288960:12345-0@lo:502: 00000100:00100000:2.0:1788592611.281281:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:8453:x1875475147288960:12345-0@lo:502: Request processed in 591us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.281290:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592611.281416:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8453:1875475147288960:0@lo:502: 00000100:00100000:3.0:1788592611.281474:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8453:1875475147289088:0@lo:502: 00000100:00100000:3.0:1788592611.281513:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592611.281590:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.281630:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289088 00000100:00100000:1.0:1788592611.281638:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289088 00000100:00100000:1.0:1788592611.281798:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788592611.281807:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:8453:x1875475147289088:12345-0@lo:502: 00000100:00100000:1.0:1788592611.282051:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:8453:x1875475147289088:12345-0@lo:502: Request processed in 245us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.282058:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788592611.282550:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8453:1875475147289088:0@lo:502: 00000040:00080000:3.0:1788592611.282582:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788592611.283222:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788592611.283261:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592611.283275:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.283291:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592611.283303:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788592611.283306:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788592611.283309:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788592611.283387:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.283397:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.283408:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.283431:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289216:0@lo:101: 00000100:00100000:0.0:1788592611.283488:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.283524:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.283607:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289216 00000100:00100000:2.0:1788592611.283616:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289216 00000100:00100000:2.0:1788592611.283667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788592611.283677:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+13:5820:x1875475147289216:12345-0@lo:101: 00010000:00010000:2.0:1788592611.283689:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592611.283703:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4e00/0x27b316f132510a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a01 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592611.283964:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4e00/0x27b316f132510a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a01 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592611.283977:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4e00/0x27b316f132510a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a01 expref: 14 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592611.284004:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4e00, rc 0) 00000100:00100000:2.0:1788592611.284054:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289216:12345-0@lo:101: Request processed in 378us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.284060:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788592611.284285:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289216:0@lo:101: 00010000:00010000:0.0:1788592611.284301:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.284311:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.284426:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289344:0@lo:501: 00000100:00100000:0.0:1788592611.284455:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.284477:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.284535:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289344 00000100:00100000:2.0:1788592611.284540:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289344 00000100:00100000:2.0:1788592611.284573:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788592611.284579:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289344:12345-0@lo:501: 00000100:00100000:2.0:1788592611.285184:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289344:12345-0@lo:501: Request processed in 602us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.285193:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788592611.285557:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289344:0@lo:501: 00000100:00100000:0.0:1788592611.285604:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289472:0@lo:503: 00000100:00100000:0.0:1788592611.285655:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.285691:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.286189:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289472 00000100:00100000:2.0:1788592611.286198:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289472 00000100:00100000:2.0:1788592611.286286:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788592611.286297:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289472:12345-0@lo:503: 00000100:00100000:2.0:1788592611.286558:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289472:12345-0@lo:503: Request processed in 263us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.286565:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788592611.286875:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289472:0@lo:503: 00000100:00100000:0.0:1788592611.287574:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8454:1875475147289600:0@lo:502: 00000100:00100000:0.0:1788592611.287635:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.287723:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989363c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.288013:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289600 00000100:00100000:1.0:1788592611.288022:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289600 00000100:00100000:1.0:1788592611.288071:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788592611.288081:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8454:x1875475147289600:12345-0@lo:502: 00000100:00100000:1.0:1788592611.288374:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8454:x1875475147289600:12345-0@lo:502: Request processed in 294us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.288382:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788592611.291728:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8454:1875475147289600:0@lo:502: 00000020:01000000:2.0:1788592611.291804:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592611.291824:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592611.291827:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788592611.291835:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788592611.292031:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8454:1875475147289728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.292151:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.292217:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.292494:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289728 00000100:00100000:0.0:1788592611.292503:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289728 00000100:00100000:0.0:1788592611.292560:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788592611.292571:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8454:x1875475147289728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.293000:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:8454:x1875475147289728:12345-0@lo:502:llog_process_th.0 Request processed in 430us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.293010:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788592611.293214:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8454:1875475147289728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592611.293249:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592611.293255:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592611.293257:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788592611.293262:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788592611.293555:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788592611.293601:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788592611.293628:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.293640:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592611.293658:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592611.293662:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898188438800 from 39 10000000:01000000:0.0:1788592611.293665:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592611.293700:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.293874:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.293894:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.293918:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.293965:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.294001:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981885a4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.294125:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289856 00000100:00100000:1.0:1788592611.294133:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289856 00000100:00100000:1.0:1788592611.294179:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788592611.294190:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:5820:x1875475147289856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592611.294201:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592611.294215:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813dee00/0x27b316f132510a16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a0f expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.294241:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813dee00/0x27b316f132510a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a0f expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.294252:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813dee00/0x27b316f132510a16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a0f expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.294261:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813dee00, rc 0) 00000100:00100000:1.0:1788592611.294310:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147289856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.294326:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788592611.294520:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592611.294536:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.294544:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.294602:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.294632:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.294699:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981885a4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788592611.297465:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147289984 00000100:00100000:3.0:1788592611.297482:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147289984 00000100:00100000:3.0:1788592611.297604:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788592611.297616:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147289984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592611.298044:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147289984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592611.298053:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788592611.298160:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147289984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592611.298256:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592611.298311:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.299739:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290112 00000100:00100000:1.0:1788592611.299753:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290112 00000100:00100000:1.0:1788592611.299816:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788592611.299825:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147290112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.300093:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147290112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 268us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.300102:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788592611.300250:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592611.300275:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592611.302309:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8455:1875475147290240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.302685:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.302764:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.302807:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290240 00000100:00100000:0.0:1788592611.302815:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290240 00000100:00100000:0.0:1788592611.302926:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788592611.302937:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8455:x1875475147290240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.303748:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8455:x1875475147290240:12345-0@lo:502:llog_process_th.0 Request processed in 808us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.303760:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788592611.303951:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8455:1875475147290240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.304030:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8455:1875475147290368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.304084:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.304263:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.304313:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290368 00000100:00100000:0.0:1788592611.304321:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290368 00000100:00100000:0.0:1788592611.304417:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788592611.304426:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8455:x1875475147290368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.304680:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:8455:x1875475147290368:12345-0@lo:502:llog_process_th.0 Request processed in 255us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.304688:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592611.304804:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8455:1875475147290368:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788592611.304836:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:2.0:1788592611.306383:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592611.306504:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592611.306508:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778368 00000100:00100000:3.0:1788592611.306528:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778368 00000100:00100000:3.0:1788592611.306607:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:3.0:1788592611.306620:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:2343:x1875475136778368:12345-192.168.204.20@tcp:400: 00000100:00100000:0.0:1788592611.307364:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778496 00000100:00100000:0.0:1788592611.307376:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778496 00000100:00100000:0.0:1788592611.307458:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1788592611.307471:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136778496:12345-192.168.204.20@tcp:400: 00000100:00100000:3.0:1788592611.307572:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:2343:x1875475136778368:12345-192.168.204.20@tcp:400: Request processed in 946us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592611.307590:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00080000:1.0:1788592611.307730:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788592611.307747:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788592611.307791:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592611.307805:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.307821:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592611.307831:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788592611.307834:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788592611.307837:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788592611.307880:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.307889:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.307901:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592611.307954:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.308024:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.308078:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.308098:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290496 00000100:00100000:1.0:1788592611.308103:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290496 00000100:00100000:1.0:1788592611.308157:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788592611.308165:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:5820:x1875475147290496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592611.308175:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592611.308189:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813df200/0x27b316f132510a24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a1d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.308214:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813df200/0x27b316f132510a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a1d expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.308225:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813df200/0x27b316f132510a24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a1d expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.308234:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813df200, rc 0) 00000100:00100000:1.0:1788592611.308268:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147290496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.308275:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788592611.308336:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592611.308376:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.308387:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592611.308454:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.308485:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.308500:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.308512:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290624 00000100:00100000:1.0:1788592611.308516:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290624 00000100:00100000:1.0:1788592611.308532:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788592611.308538:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147290624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.308847:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147290624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.308854:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788592611.308885:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.308915:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.308958:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.308973:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.308986:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290752 00000100:00100000:1.0:1788592611.308989:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290752 00000100:00100000:1.0:1788592611.309010:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592611.309016:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147290752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.309197:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147290752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.309203:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788592611.309245:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147290752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.312028:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8456:1875475147290880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.312324:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.312400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147290880 00000100:00100000:1.0:1788592611.312408:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147290880 00000100:00100000:1.0:1788592611.312461:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788592611.312471:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8456:x1875475147290880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.312830:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8456:x1875475147290880:12345-0@lo:502:llog_process_th.0 Request processed in 360us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.312840:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788592611.312909:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.312939:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8456:1875475147290880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592611.312984:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592611.312997:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592611.313000:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788592611.313086:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788592611.313103:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136778496:12345-192.168.204.20@tcp:400: Request processed in 5602us (6565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.313126:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1788592611.313296:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8456:1875475147291008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.313340:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.313398:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.313625:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291008 00000100:00100000:0.0:1788592611.313632:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291008 00000100:00100000:0.0:1788592611.313670:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788592611.313678:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8456:x1875475147291008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.313872:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:8456:x1875475147291008:12345-0@lo:502:llog_process_th.0 Request processed in 194us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.313879:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788592611.313988:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8456:1875475147291008:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592611.314015:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592611.314022:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592611.314024:0:8456:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788592611.314030:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788592611.314216:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788592611.314255:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788592611.314268:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314280:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592611.314291:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788592611.314294:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff898190067800 from 39 10000000:01000000:0.0:1788592611.314297:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592611.314330:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314338:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314370:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.314389:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.314422:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.314443:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.314457:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291136 00000100:00100000:0.0:1788592611.314462:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291136 00000100:00100000:0.0:1788592611.314488:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788592611.314495:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147291136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592611.314505:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592611.314518:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762e000/0x27b316f132510a32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a2b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314557:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762e000/0x27b316f132510a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a2b expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314569:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762e000/0x27b316f132510a32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a2b expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314581:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e000, rc 0) 00000100:00100000:0.0:1788592611.314637:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.314644:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788592611.314681:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592611.314697:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.314707:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.314760:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.314784:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.314808:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819888e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.314818:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291264 00000100:00100000:0.0:1788592611.314821:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291264 00000100:00100000:0.0:1788592611.314842:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788592611.314848:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.315481:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 629us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.315502:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788592611.315546:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.315851:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.315898:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.315933:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819888e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.316009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291392 00000100:00100000:1.0:1788592611.316015:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291392 00000100:00100000:1.0:1788592611.316057:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788592611.316066:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.317805:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1723us (1889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.317841:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788592611.318000:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592611.318452:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592611.318542:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592611.318863:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778752 00000100:00100000:2.0:1788592611.318871:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778752 00000100:00100000:2.0:1788592611.318926:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778624 00000100:00100000:2.0:1788592611.318929:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778624 00000100:00100000:2.0:1788592611.318948:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592611.318957:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136778752:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1788592611.319029:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136778752:12345-192.168.204.20@tcp:400: Request processed in 74us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.319036:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592611.319055:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1788592611.319061:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136778624:12345-192.168.204.20@tcp:400: 00000100:00100000:2.0:1788592611.319085:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136778624:12345-192.168.204.20@tcp:400: Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592611.319090:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00080000:1.0:1788592611.320481:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592611.320494:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592611.322789:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8457:1875475147291520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.322937:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.323220:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819888e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.323702:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291520 00000100:00100000:1.0:1788592611.323790:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291520 00000100:00100000:1.0:1788592611.323891:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788592611.323902:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8457:x1875475147291520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.324314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8457:x1875475147291520:12345-0@lo:502:llog_process_th.0 Request processed in 412us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.324323:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788592611.324673:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8457:1875475147291520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.324766:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8457:1875475147291648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592611.324819:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592611.325424:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592611.325590:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291648 00000100:00100000:0.0:1788592611.325597:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291648 00000100:00100000:0.0:1788592611.325635:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788592611.325643:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8457:x1875475147291648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592611.326008:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8457:x1875475147291648:12345-0@lo:502:llog_process_th.0 Request processed in 364us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.326018:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788592611.327260:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8457:1875475147291648:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788592611.327319:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788592611.327693:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788592611.327808:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592611.327823:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.327838:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592611.327850:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788592611.327871:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788592611.327874:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788592611.327917:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.327927:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.327938:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.328032:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.328107:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.328277:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592611.328575:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291776 00000100:00100000:3.0:1788592611.328584:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291776 00000100:00100000:1.0:1788592611.328772:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788592611.328785:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147291776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592611.328802:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592611.328817:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813dfa00/0x27b316f132510a40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a39 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.328844:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813dfa00/0x27b316f132510a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a39 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.328856:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813dfa00/0x27b316f132510a40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a39 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.328864:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813dfa00, rc 0) 00000100:00100000:1.0:1788592611.333734:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147291776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4936us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.333750:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788592611.334071:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592611.334104:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.334130:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.334551:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.334623:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.334734:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.335109:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147291904 00000100:00100000:1.0:1788592611.335218:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147291904 00000100:00100000:1.0:1788592611.335475:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788592611.335487:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147291904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.336107:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147291904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 619us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.336128:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788592611.336633:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147291904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.336704:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.336872:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.336945:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.337082:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292032 00000100:00100000:1.0:1788592611.337091:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292032 00000100:00100000:1.0:1788592611.337776:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788592611.337789:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147292032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.338623:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147292032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 831us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.338635:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788592611.338805:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592611.339623:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8458:1875475147292160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592611.339695:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.339805:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292160 00000100:00100000:1.0:1788592611.339812:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292160 00000100:00100000:1.0:1788592611.339858:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788592611.339867:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8458:x1875475147292160:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.340614:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8458:x1875475147292160:12345-0@lo:502:llog_process_th.0 Request processed in 744us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.340623:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788592611.340784:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592611.340811:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8458:1875475147292160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592611.340846:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592611.340857:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592611.340860:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788592611.340869:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788592611.340904:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8458:1875475147292288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592611.340948:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592611.341075:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.341129:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292288 00000100:00100000:1.0:1788592611.341647:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292288 00000100:00100000:1.0:1788592611.341820:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788592611.341831:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8458:x1875475147292288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592611.342504:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8458:x1875475147292288:12345-0@lo:502:llog_process_th.0 Request processed in 671us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592611.342528:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788592611.345448:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8458:1875475147292288:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788592611.345905:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592611.345924:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592611.345927:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788592611.345933:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788592611.346570:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788592611.346598:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788592611.346614:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.346628:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592611.346638:0:5820:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788592611.346641:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8981884acd40 from 1 10000000:01000000:0.0:1788592611.346643:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788592611.346686:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.346694:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.346704:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592611.347078:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592611.347263:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592611.347403:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592611.347602:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292416 00000100:00100000:1.0:1788592611.347611:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292416 00000100:00100000:0.0:1788592611.347872:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788592611.347884:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147292416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592611.347901:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592611.347919:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fc00/0x27b316f132510a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a47 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.347977:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fc00/0x27b316f132510a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a47 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.347990:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fc00/0x27b316f132510a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a47 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592611.347999:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fc00, rc 0) 00000100:00100000:0.0:1788592611.348060:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147292416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592611.348067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788592611.348164:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193befb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592611.348181:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.348190:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592611.348253:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592611.348284:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592611.348683:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592611.348864:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292544 00000100:00100000:3.0:1788592611.348871:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292544 00000100:00100000:3.0:1788592611.348902:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788592611.348911:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147292544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592611.349428:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147292544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 517us (1140us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592611.349438:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788592611.349665:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147292544:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788592611.349772:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788592611.349782:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592611.349793:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592611.582623:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592612.606753:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592613.630586:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592614.371892:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592614.371984:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136778880 00000100:00100000:3.0:1788592614.371998:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136778880 00000100:00100000:3.0:1788592614.372076:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:3.0:1788592614.372096:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+8:5585:x1875475136778880:12345-192.168.204.20@tcp:101: 00010000:00010000:3.0:1788592614.372135:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592614.372159:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c5e00/0x27b316f132510a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d18f3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592614.372197:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c5e00/0x27b316f132510a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18f3 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592614.372211:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c5e00/0x27b316f132510a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18f3 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592614.372234:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5e00, rc 0) 00000100:00100000:3.0:1788592614.372308:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136778880:12345-192.168.204.20@tcp:101: Request processed in 215us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592614.372316:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:3.0:1788592614.374990:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592614.375375:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779008 00000100:00100000:2.0:1788592614.375404:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779008 00000100:00100000:2.0:1788592614.375462:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:2.0:1788592614.375473:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136779008:12345-192.168.204.20@tcp:501: 00000100:00100000:2.0:1788592614.376629:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136779008:12345-192.168.204.20@tcp:501: Request processed in 1150us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592614.376639:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:1.0:1788592614.389518:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592614.391031:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779136 00000100:00100000:0.0:1788592614.391048:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779136 00000100:00100000:0.0:1788592614.391315:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:0.0:1788592614.391328:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136779136:12345-192.168.204.20@tcp:503: 00000100:00100000:0.0:1788592614.392794:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136779136:12345-192.168.204.20@tcp:503: Request processed in 1456us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592614.392808:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:0.0:1788592614.399796:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592614.401174:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779264 00000100:00100000:2.0:1788592614.401191:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779264 00000100:00100000:2.0:1788592614.401392:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:2.0:1788592614.401403:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:6075:x1875475136779264:12345-192.168.204.20@tcp:502: 00000100:00100000:2.0:1788592614.402022:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:6075:x1875475136779264:12345-192.168.204.20@tcp:502: Request processed in 616us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592614.402032:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:3.0:1788592614.409386:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592614.413325:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779392 00000100:00100000:0.0:1788592614.413362:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779392 00000100:00100000:0.0:1788592614.413464:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:0.0:1788592614.413542:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:6075:x1875475136779392:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592614.414327:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:6075:x1875475136779392:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 847us (4977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592614.414338:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:1.0:1788592614.420131:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592614.420939:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779520 00000100:00100000:2.0:1788592614.420954:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779520 00000100:00100000:2.0:1788592614.421102:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:2.0:1788592614.421115:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136779520:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592614.421137:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592614.421161:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4600/0x27b316f132510a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d18fa expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592614.421195:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4600/0x27b316f132510a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18fa expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592614.421207:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4600/0x27b316f132510a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18fa expref: 10 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592614.421239:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4600, rc 0) 00000100:00100000:2.0:1788592614.421327:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136779520:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 215us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592614.421335:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:0.0:1788592614.430121:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592614.430216:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779648 00000100:00100000:3.0:1788592614.430228:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779648 00000100:00100000:3.0:1788592614.430292:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:3.0:1788592614.430302:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136779648:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592614.431255:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136779648:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 948us (1142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592614.431267:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00010000:00010000:3.0:1788592614.654598:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592615.678475:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592616.190583:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.190658:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147292800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592616.190666:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.190711:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.191153:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592616.191163:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147292928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592616.191213:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.191247:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292800 00000100:00100000:2.0:1788592616.191256:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292800 00000100:00100000:2.0:1788592616.191312:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292928 00000100:00100000:2.0:1788592616.191315:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292928 00000100:00100000:2.0:1788592616.191337:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592616.191347:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147292800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592616.191485:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592616.191539:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147292800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.191547:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592616.191567:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788592616.191574:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147292928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592616.191593:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592616.191621:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147292928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.191627:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788592616.191673:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb249c00 x1875475147292928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592616.191694:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147292928:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788592616.191709:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e4e00 x1875475147292800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592616.191722:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147292800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592616.192675:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592616.192692:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147293056:0@lo:400:kworker.0 00000100:00100000:0.0:1788592616.192750:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592616.192807:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147292672 00000100:00100000:0.0:1788592616.192815:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147292672 00000100:00100000:0.0:1788592616.192858:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788592616.192866:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147292672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.192916:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293056 00000100:00100000:0.0:1788592616.192918:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147292672:12345-0@lo:400:kworker.0 Request processed in 52us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.192923:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293056 00000100:00100000:0.0:1788592616.192929:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788592616.192966:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592616.192976:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147293056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.193033:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147293056:12345-0@lo:400:kworker.0 Request processed in 59us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592616.193034:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147292672:0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.193048:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592616.193071:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147293056:0@lo:400:kworker.0 00000100:00080000:0.0:1788592616.193608:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592616.193616:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592616.195272:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147293184:0@lo:400:kworker.0 00000100:00100000:0.0:1788592616.195341:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.195877:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293184 00000100:00100000:2.0:1788592616.195888:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293184 00000100:00100000:2.0:1788592616.195958:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592616.195968:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147293184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592616.196173:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147293312:0@lo:400:kworker.0 00000100:00100000:1.0:1788592616.196211:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.198563:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147293184:12345-0@lo:400:kworker.0 Request processed in 2585us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592616.198564:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147293184:0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.198585:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592616.198628:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293312 00000100:00100000:2.0:1788592616.198636:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293312 00000100:00100000:2.0:1788592616.198694:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592616.198705:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147293312:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788592616.198718:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592616.198806:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147293312:12345-0@lo:400:kworker.0 Request processed in 103us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.198829:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788592616.199689:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147293312:0@lo:400:kworker.0 00000100:00100000:2.0:1788592616.421730:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592616.421771:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592616.421808:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592616.421833:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592616.421873:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780160 00000100:00100000:2.0:1788592616.421887:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780160 00000100:00100000:2.0:1788592616.421957:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780032 00000100:00100000:2.0:1788592616.421961:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780032 00000100:00100000:2.0:1788592616.421980:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1788592616.421990:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136780160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592616.422082:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136780160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.422090:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1788592616.422108:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1788592616.422115:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136780032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592616.422139:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136780032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.422145:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1788592616.422163:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779776 00000100:00100000:2.0:1788592616.422167:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779776 00000100:00100000:2.0:1788592616.422192:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:2.0:1788592616.422198:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136779776:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592616.422220:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136779776:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.422243:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:0.0:1788592616.422430:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136779904 00000100:00100000:0.0:1788592616.422435:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136779904 00000100:00100000:0.0:1788592616.422474:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1788592616.422488:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136779904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592616.422534:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136779904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592616.422541:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00080000:0.0:1788592616.422564:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592616.422570:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592616.422572:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788592616.519971:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc463b2bc0 20000000:00000080:0.0:1788592616.519994:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89808658e800 uarg=0000000000000000 20000000:01000000:0.0:1788592616.520052:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788592616.520059:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788592616.520065:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788592616.522820:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788592616.523102:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788592616.531668:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788592616.531743:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788592616.531813:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788592616.531833:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788592616.531857:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531878:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325107d1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531886:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531893:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f1325108fe expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531902:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531909:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531959:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 9 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.531979:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 9 pid: 5818 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.531996:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293440:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592616.532179:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.532189:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 18 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.532206:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293568:0@lo:104: 00000100:00100000:1.0:1788592616.532248:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592616.532295:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.532305:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.532313:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293696:0@lo:104: 00000100:00100000:1.0:1788592616.532338:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592616.532396:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.532405:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 18 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.532414:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293824:0@lo:104: 00000100:00100000:1.0:1788592616.532433:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff898189584300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592616.532614:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788592616.532635:0:5806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592616.532649:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293568 00000100:00100000:0.0:1788592616.532657:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293568 00000100:00100000:0.0:1788592616.532703:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293696 00000100:00100000:0.0:1788592616.532706:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293696 00000100:00100000:0.0:1788592616.532715:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293824 00000100:00100000:0.0:1788592616.532717:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293824 00000100:00100000:0.0:1788592616.532732:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592616.533160:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:8497:x1875475147293568:12345-0@lo:104: 00010000:00010000:0.0:1788592616.533178:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.533318:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293568:0@lo:104: 00010000:00010000:0.0:1788592616.533344:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592616.533517:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:8497:x1875475147293568:12345-0@lo:104: Request processed in 777us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592616.533535:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592616.533561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592616.533568:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf48d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:8497:x1875475147293696:12345-0@lo:104: 00010000:00010000:0.0:1788592616.533577:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.533947:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293696:0@lo:104: 00010000:00010000:2.0:1788592616.537525:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592616.537542:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537555:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592616.537560:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537574:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592616.537582:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592616.537589:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592616.537663:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537671:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592616.537711:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537719:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c4600/0x27b316f1325108fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510905 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537738:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592616.537741:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537775:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dea00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592616.537778:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537785:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592616.537791:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592616.537797:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592616.537813:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537819:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592616.537833:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537839:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dea00/0x27b316f132510833 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f13251083a expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.537849:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592616.537851:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592616.537853:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592616.537863:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592616.537886:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147293952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592616.537957:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.538024:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147294080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592616.538057:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.538098:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147293952 00000100:00100000:2.0:1788592616.538107:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147293952 00010000:00010000:2.0:1788592616.538141:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 19 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592616.538170:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294080 00000100:00100000:2.0:1788592616.538173:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294080 00010000:00010000:2.0:1788592616.538187:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510833 expref: 20 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592616.538200:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592616.538208:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+20:3285:x1875475147293952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592616.538221:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592616.538226:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 20 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538236:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 20 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538251:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fe00/0x27b316f132510905 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f1325108fe expref: 20 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538266:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592616.538300:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147293952:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.538307:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788592616.538326:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592616.538333:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3283:x1875475147294080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592616.538380:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592616.538385:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538393:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538403:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e9800/0x27b316f13251083a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510833 expref: 18 pid: 5817 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.538412:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592616.538437:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3283:x1875475147294080:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.538442:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592616.538481:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147294080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592616.538505:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147293952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592616.539459:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788592616.539474:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf48d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:8497:x1875475147293696:12345-0@lo:104: Request processed in 5903us (7131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592616.539485:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592616.543381:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592616.543410:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:8497:x1875475147293824:12345-0@lo:104: 00010000:00010000:1.0:1788592616.543439:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.543568:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592616.543575:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:8497:x1875475147293824:12345-0@lo:104: Request processed in 180us (10939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592616.543598:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788592616.543713:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592616.543723:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.543731:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dec00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592616.543736:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.543745:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592616.543753:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592616.543777:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592616.543827:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.543834:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592616.543854:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.543861:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dec00/0x27b316f1325107d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f1325107d8 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.543882:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592616.543883:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592616.543885:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592616.543903:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147294208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592616.543950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592616.544026:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294208 00000100:00100000:2.0:1788592616.544034:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294208 00010000:00010000:2.0:1788592616.544064:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 17 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592616.544092:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788592616.544099:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3284:x1875475147294208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592616.544113:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592616.544119:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 17 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.544129:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 17 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592616.544162:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592616.544195:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3284:x1875475147294208:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592616.544201:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788592616.544239:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147294208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592616.544298:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762f800/0x27b316f1325107d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f1325107d1 expref: 16 pid: 5815 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592616.544309:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293824:0@lo:104: 00010000:00010000:3.0:1788592616.545538:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592616.545700:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592616.545998:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780288 00000100:00100000:3.0:1788592616.546007:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780288 00010000:00010000:3.0:1788592616.546060:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 10 pid: 5818 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592616.546100:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592616.546111:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2343:x1875475136780288:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592616.546125:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592616.546131:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 10 pid: 5818 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546146:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 10 pid: 5818 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546168:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546178:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546195:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546204:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546211:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546219:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546238:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813df800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592616.546242:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546251:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546261:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.546273:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592616.546329:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2343:x1875475136780288:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 219us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592616.546338:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00010000:00010000:1.0:1788592616.546930:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762ee00/0x27b316f1325109c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18c2 expref: 9 pid: 5818 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592616.546951:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875475147293440:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592616.546990:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.547001:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.547007:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592616.547025:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813df800/0x27b316f132510a63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592616.704022:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592617.727273:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788592618.175606:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592618.175618:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819840e800 from 4 10000000:01000000:0.0:1788592618.175624:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592618.175693:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.175716:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.175728:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592618.175761:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.175851:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.175918:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898191a78900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592618.176100:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294336 00000100:00100000:2.0:1788592618.176109:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294336 00000100:00100000:2.0:1788592618.176177:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788592618.176188:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147294336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592618.176203:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592618.176220:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a6a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592618.176247:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a6a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592618.176259:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a6a expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592618.176271:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592618.176323:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592618.176338:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788592618.176444:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592618.176462:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592618.176472:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592618.176534:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592618.176561:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592618.176583:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592618.176597:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294464 00000100:00100000:2.0:1788592618.176600:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294464 00000100:00100000:2.0:1788592618.176622:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788592618.176629:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592618.177133:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592618.177142:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788592618.177177:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592618.177213:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592618.177254:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592618.177269:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592618.177283:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294592 00000100:00100000:2.0:1788592618.177286:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294592 00000100:00100000:2.0:1788592618.177309:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788592618.177323:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592618.179261:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1928us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592618.179276:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788592618.179579:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb360380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.182942:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8557:1875475147294720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.183055:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.183109:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff898191a78780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592618.183180:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294720 00000100:00100000:2.0:1788592618.183188:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294720 00000100:00100000:2.0:1788592618.183246:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592618.183257:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8557:x1875475147294720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592618.183622:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8557:x1875475147294720:12345-0@lo:502:llog_process_th.0 Request processed in 366us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592618.183631:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788592618.183891:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8557:1875475147294720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.183928:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592618.183940:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.183943:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592618.183957:0:8557:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89819840e800 00000020:00000080:0.0:1788592618.183959:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592618.184077:0:8557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8557:1875475147294848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.184116:0:8557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.184140:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294848 00000100:00100000:0.0:1788592618.184144:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294848 00000100:00100000:0.0:1788592618.184169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788592618.184176:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8557:x1875475147294848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.184314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:8557:x1875475147294848:12345-0@lo:502:llog_process_th.0 Request processed in 137us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.184321:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788592618.184458:0:8557:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184ee4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.184474:0:8557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8557:1875475147294848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.184494:0:8557:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592618.184500:0:8557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.184502:0:8557:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788592618.184507:0:8557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788592618.187398:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788592618.187438:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592618.187451:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187465:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592618.187488:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592618.187492:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898188438800 from 4 10000000:01000000:0.0:1788592618.187495:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592618.187542:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187551:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187563:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592618.187592:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.187679:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.187726:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.187752:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147294976 00000100:00100000:0.0:1788592618.187759:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147294976 00000100:00100000:0.0:1788592618.187811:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592618.187821:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147294976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592618.187835:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592618.187850:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a78 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187875:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a78 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187885:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a78 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.187906:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592618.187948:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147294976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.187956:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788592618.188029:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147294976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592618.188048:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.188059:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592618.188117:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.188148:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.188169:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.188182:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295104 00000100:00100000:0.0:1788592618.188186:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295104 00000100:00100000:0.0:1788592618.188209:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788592618.188215:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147295104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.188550:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147295104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.188558:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788592618.188596:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.188629:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.188674:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.188706:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989363c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.188719:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295232 00000100:00100000:0.0:1788592618.188723:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295232 00000100:00100000:0.0:1788592618.188752:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788592618.188760:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147295232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.188932:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147295232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.188940:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788592618.188992:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.190975:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8558:1875475147295360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.191077:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.191117:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295360 00000100:00100000:0.0:1788592618.191124:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295360 00000100:00100000:0.0:1788592618.191170:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788592618.191180:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8558:x1875475147295360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.191509:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8558:x1875475147295360:12345-0@lo:502:llog_process_th.0 Request processed in 330us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.191517:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788592618.191576:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff898191a78900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.191601:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8558:1875475147295360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.191633:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592618.191646:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.191648:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592618.191661:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff898188438800 00000020:00000080:0.0:1788592618.191663:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592618.192558:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8558:1875475147295488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.195506:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.195576:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295488 00000100:00100000:0.0:1788592618.195586:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295488 00000100:00100000:0.0:1788592618.195642:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788592618.195654:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8558:x1875475147295488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.195950:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:8558:x1875475147295488:12345-0@lo:502:llog_process_th.0 Request processed in 298us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.195958:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788592618.196038:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.196068:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8558:1875475147295488:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.196107:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592618.196117:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.196120:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788592618.196129:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788592618.196200:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788592618.196217:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592618.196228:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196240:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592618.196251:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592618.196254:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898190067800 from 4 10000000:01000000:0.0:1788592618.196258:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592618.196293:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196301:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196322:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592618.196344:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.196415:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.196436:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.196452:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295616 00000100:00100000:0.0:1788592618.196456:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295616 00000100:00100000:0.0:1788592618.196482:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788592618.196488:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147295616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592618.196498:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592618.196513:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510a86 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196538:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510a86 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196548:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a86 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196557:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb600, rc 0) 00000100:00100000:0.0:1788592618.196589:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147295616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.196596:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788592618.196627:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592618.196641:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.196658:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592618.196707:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.196736:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.196752:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.196766:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295744 00000100:00100000:0.0:1788592618.196770:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295744 00000100:00100000:0.0:1788592618.196792:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788592618.196798:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147295744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.197092:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147295744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.197100:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788592618.197142:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.197172:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.197218:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.197237:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.197251:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147295872 00000100:00100000:0.0:1788592618.197254:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147295872 00000100:00100000:0.0:1788592618.197287:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788592618.197294:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147295872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.197454:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147295872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.197460:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788592618.197504:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147295872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.199329:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8561:1875475147296000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.199524:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.199566:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296000 00000100:00100000:0.0:1788592618.199573:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296000 00000100:00100000:0.0:1788592618.199618:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788592618.199628:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:8561:x1875475147296000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.201590:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:8561:x1875475147296000:12345-0@lo:502:llog_process_th.0 Request processed in 1953us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.201608:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788592618.201697:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff8980868b5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.202241:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8561:1875475147296000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.202286:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592618.202300:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.202302:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788592618.202314:0:8561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff898190067800 00000020:00000080:0.0:1788592618.202316:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788592618.203879:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8561:1875475147296128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.203976:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592618.204032:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296128 00000100:00100000:0.0:1788592618.204040:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296128 00000100:00100000:0.0:1788592618.204091:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788592618.204100:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:8561:x1875475147296128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592618.204347:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:8561:x1875475147296128:12345-0@lo:502:llog_process_th.0 Request processed in 246us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.205492:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788592618.205597:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187f073c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592618.205627:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:8561:1875475147296128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592618.205677:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592618.205686:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592618.205689:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788592618.205698:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788592618.206592:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788592618.206615:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592618.206628:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.206643:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592618.409854:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592618.412136:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780416 00000100:00100000:0.0:1788592618.412158:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780416 00000100:00100000:0.0:1788592618.412277:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:0.0:1788592618.412290:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:5585:x1875475136780416:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592618.412312:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592618.412337:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1901 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.412418:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.412432:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 10 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592618.412443:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592618.412551:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136780416:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 263us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.412558:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:3.0:1788592618.418502:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592618.418729:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780544 00000100:00100000:0.0:1788592618.418741:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780544 00000100:00100000:0.0:1788592618.418822:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:0.0:1788592618.418844:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136780544:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.419191:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136780544:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 358us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.419198:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:3.0:1788592618.425190:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592618.425915:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780672 00000100:00100000:0.0:1788592618.425935:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780672 00000100:00100000:0.0:1788592618.426038:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:0.0:1788592618.426053:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136780672:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592618.428874:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:5585:x1875475136780672:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 2814us (3689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.428890:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:3.0:1788592618.444318:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592618.444608:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780800 00000100:00100000:0.0:1788592618.444620:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780800 00000100:00100000:0.0:1788592618.444694:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:0.0:1788592618.444706:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:6139:x1875475136780800:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592618.445207:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:6139:x1875475136780800:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 500us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.445219:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:3.0:1788592618.453824:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592618.454906:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136780928 00000100:00100000:0.0:1788592618.454940:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136780928 00000100:00100000:0.0:1788592618.455070:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:0.0:1788592618.455083:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:6139:x1875475136780928:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592618.455748:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:6139:x1875475136780928:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 664us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592618.455759:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 192 00010000:00010000:0.0:1788592618.752652:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592619.775528:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592620.799693:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592621.310569:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147296512:0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.310662:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592621.310740:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592621.310747:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147296640:0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.310791:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592621.310840:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296512 00000100:00100000:1.0:1788592621.310849:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296512 00000100:00100000:1.0:1788592621.310915:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592621.310939:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147296512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.311000:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147296512:12345-0@lo:400:kworker.0 Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.311019:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592621.311186:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296640 00000100:00100000:1.0:1788592621.311191:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296640 00000100:00100000:1.0:1788592621.311389:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592621.311397:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.311435:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147296640:12345-0@lo:400:kworker.0 Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.311441:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788592621.311490:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90d500 x1875475147296640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592621.311507:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147296640:0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.311517:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147296512:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311609:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147296384:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311642:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.311666:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311684:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.311710:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592621.311716:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147296256:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311741:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.311759:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147296768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311791:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592621.311814:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592621.311818:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592621.311829:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296896 00000100:00100000:0.0:1788592621.311833:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296896 00000100:00100000:0.0:1788592621.311861:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592621.311868:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147296896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.311902:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147296896:12345-0@lo:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.311909:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592621.311941:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296256 00000100:00100000:0.0:1788592621.311956:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296256 00000100:00100000:0.0:1788592621.311984:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788592621.311990:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147296256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.312019:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147296256:12345-0@lo:400:kworker.0 Request processed in 30us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.312151:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296384 00000100:00100000:1.0:1788592621.312155:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296384 00000100:00100000:1.0:1788592621.312175:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147296768 00000100:00100000:1.0:1788592621.312177:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147296768 00000100:00100000:1.0:1788592621.312194:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592621.312211:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147296384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.312243:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147296384:12345-0@lo:400:kworker.0 Request processed in 34us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.312249:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788592621.312261:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592621.312266:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147296768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.312287:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147296768:12345-0@lo:400:kworker.0 Request processed in 21us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.312302:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788592621.312335:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592621.312338:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592621.312386:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147296256:0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.312396:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147296768:0@lo:400:kworker.0 00000100:00100000:1.0:1788592621.312404:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147296384:0@lo:400:kworker.0 00010000:00080000:1.0:1788592621.312413:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90df80 x1875475147296896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592621.312421:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147296896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592621.312486:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788592621.316745:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592621.317135:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592621.317207:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297024 00000100:00100000:0.0:1788592621.317217:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297024 00000100:00100000:0.0:1788592621.317274:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592621.317284:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592621.317600:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592621.317652:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 369us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.317660:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788592621.317710:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90df80 x1875475147297024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592621.317731:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592621.322424:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592621.322455:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592621.322554:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592621.322615:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297152 00000100:00100000:3.0:1788592621.322624:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297152 00000100:00100000:3.0:1788592621.322682:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788592621.322692:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592621.322735:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592621.325375:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2660us (2797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592621.325391:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788592621.325459:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb248000 x1875475147297152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592637 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592621.325485:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592621.543465:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592621.543519:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592621.543557:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592621.543608:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592621.543647:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781184 00000100:00100000:1.0:1788592621.543660:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781184 00000100:00100000:1.0:1788592621.543739:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:1.0:1788592621.543751:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136781184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592621.544095:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781056 00000100:00100000:0.0:1788592621.544102:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781056 00000100:00100000:0.0:1788592621.544139:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:0.0:1788592621.544147:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136781056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592621.544236:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136781056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.544243:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136781184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 492us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.544266:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:2.0:1788592621.544298:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781312 00000100:00100000:2.0:1788592621.544304:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781312 00000100:00100000:1.0:1788592621.544329:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1788592621.544380:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781440 00000100:00100000:2.0:1788592621.544385:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781440 00000100:00100000:1.0:1788592621.544394:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1788592621.544405:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136781312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592621.544409:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788592621.544411:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788592621.544418:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788592621.544422:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1788592621.544432:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136781440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592621.544439:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136781312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 35us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592621.544454:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592621.544468:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136781440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592621.544476:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00080000:1.0:1788592621.544479:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592621.544485:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592621.544489:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592621.823562:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592622.851812:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592623.573855:0:8796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788592623.871596:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592624.903692:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592625.918763:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592626.430621:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147297536:0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.430746:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592626.430808:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592626.430815:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297664:0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.430868:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592626.430925:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297536 00000100:00100000:1.0:1788592626.430935:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297536 00000100:00100000:1.0:1788592626.431008:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592626.431019:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147297536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.431075:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147297536:12345-0@lo:400:kworker.0 Request processed in 58us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.431084:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788592626.431249:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297664 00000100:00100000:1.0:1788592626.431254:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297664 00000100:00100000:1.0:1788592626.431285:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592626.431292:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.431473:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147297664:12345-0@lo:400:kworker.0 Request processed in 180us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.431480:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788592626.431497:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592626.431508:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788592626.431543:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90f100 x1875475147297664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592626.431557:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147297664:0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.431567:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147297536:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.431755:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147297408:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.431788:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592626.431805:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147297920:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.431836:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592626.431865:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592626.431870:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147297280:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.431899:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592626.431919:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147297792:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.431940:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592626.431965:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297920 00000100:00100000:0.0:1788592626.431968:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297920 00000100:00100000:0.0:1788592626.432856:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592626.432871:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147297920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.432940:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147297920:12345-0@lo:400:kworker.0 Request processed in 74us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592626.432947:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592626.433395:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297280 00000100:00100000:0.0:1788592626.433403:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297280 00000100:00100000:0.0:1788592626.433453:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788592626.433460:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147297280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.433496:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147297280:12345-0@lo:400:kworker.0 Request processed in 36us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592626.433503:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788592626.433550:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147297280:0@lo:400:kworker.0 00010000:00080000:0.0:1788592626.433570:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90df80 x1875475147297920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592626.433581:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147297920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.433746:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297408 00000100:00100000:1.0:1788592626.433751:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297408 00000100:00100000:1.0:1788592626.433783:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147297792 00000100:00100000:1.0:1788592626.433786:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147297792 00000100:00100000:1.0:1788592626.433811:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592626.433817:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147297408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.433875:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147297408:12345-0@lo:400:kworker.0 Request processed in 58us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.433881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788592626.433900:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592626.433906:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147297792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592626.433934:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147297792:12345-0@lo:400:kworker.0 Request processed in 29us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.433940:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788592626.433972:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147298176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592626.434258:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592626.434290:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592626.434296:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147298048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788592626.440836:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592626.440848:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592626.441124:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298176 00000100:00100000:3.0:1788592626.441264:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298176 00000100:00100000:3.0:1788592626.441435:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788592626.441448:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147298176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592626.441913:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592626.441978:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147297792:0@lo:400:kworker.0 00000100:00100000:0.0:1788592626.442007:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147297408:0@lo:400:kworker.0 00000100:00100000:3.0:1788592626.442069:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147298176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 624us (7811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592626.442078:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592626.447572:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592626.447795:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298048 00000100:00100000:3.0:1788592626.447807:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298048 00010000:00080000:1.0:1788592626.447835:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc186680 x1875475147298176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592626.447877:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147298176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592626.447889:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592626.447899:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147298048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592626.447941:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592626.448034:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147298048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (13715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592626.448042:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788592626.448242:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb248000 x1875475147298048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592642 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592626.448256:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147298048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592626.661517:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592626.661566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592626.661683:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781696 00000100:00100000:3.0:1788592626.661701:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781696 00000100:00100000:1.0:1788592626.661743:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781568 00000100:00100000:1.0:1788592626.661755:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781568 00000100:00100000:3.0:1788592626.661856:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:1.0:1788592626.661856:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:1.0:1788592626.661871:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136781568:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592626.661893:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136781696:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592626.661968:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136781568:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592626.661978:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136781696:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.661991:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:3.0:1788592626.661997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00080000:0.0:1788592626.662220:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592626.667768:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592626.667842:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592626.667901:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781824 00000100:00100000:1.0:1788592626.667920:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781824 00000100:00080000:3.0:1788592626.668051:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592626.668407:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136781952 00000100:00100000:0.0:1788592626.668414:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136781952 00000100:00100000:1.0:1788592626.668594:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1788592626.668607:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2340:x1875475136781824:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:1.0:1788592626.668664:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325109d0 00000100:00080000:1.0:1788592626.668675:0:6678:0:(import.c:65:import_set_state_nolock()) ffff898084bc4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788592626.668733:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788592626.669158:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+2:2340:x1875475136781824:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 552us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592626.669166:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00010000:00010000:1.0:1788592626.669245:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592626.673799:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592626.674956:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1788592626.674983:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2340:x1875475136781952:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:0.0:1788592626.675046:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325109d7 00000100:00080000:0.0:1788592626.675061:0:6676:0:(import.c:65:import_set_state_nolock()) ffff898084bc1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592626.675161:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788592626.676914:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+2:2340:x1875475136781952:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 1934us (9059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592626.676942:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00010000:00010000:3.0:1788592626.677177:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592626.944966:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592627.966674:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592628.990990:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592629.398321:0:9039:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing yml_node 00010000:00010000:3.0:1788592630.027941:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592631.039636:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788592631.115186:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:2.0:1788592631.115197:0:7632:0:(genops.c:885:class_export_put()) final put ffff898084bc6800/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:3.0:1788592631.115284:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc6800/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-OST0001 00000020:00000080:3.0:1788592631.115340:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084bc1800 for lustre-OST0001 00000100:00100000:1.0:1788592631.550600:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147298304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592631.551067:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147298432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592631.551129:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147298688:0@lo:400:kworker.0 00000100:00100000:2.0:1788592631.551200:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147298560:0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.559011:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592631.559115:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147298944:0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.559146:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592631.559166:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592631.559197:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147299200:0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.559200:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592631.559209:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147298816:0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.559235:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592631.559242:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592631.559269:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592631.559280:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147299072:0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.559302:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298432 00000100:00100000:1.0:1788592631.559311:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592631.559312:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298432 00000100:00100000:1.0:1788592631.559370:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298944 00000100:00100000:1.0:1788592631.559375:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298944 00000100:00100000:3.0:1788592631.559406:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592631.559417:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875475147298432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592631.559458:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592631.559463:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299200 00000100:00100000:1.0:1788592631.559469:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299200 00000100:00100000:1.0:1788592631.559503:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788592631.559511:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1875475147298944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.559517:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1875475147298432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592631.559541:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592631.559569:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298688 00000100:00100000:3.0:1788592631.559573:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298688 00000100:00100000:3.0:1788592631.559597:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298816 00000100:00100000:3.0:1788592631.559600:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298816 00000100:00100000:3.0:1788592631.559612:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299072 00000100:00100000:3.0:1788592631.559614:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299072 00000100:00100000:3.0:1788592631.559627:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592631.559632:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147298688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.559675:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147298944:12345-0@lo:400:kworker.0 Request processed in 164us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592631.559680:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147298688:12345-0@lo:400:kworker.0 Request processed in 46us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592631.559688:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592631.559691:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592631.559706:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592631.559715:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147298816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.559718:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592631.559740:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147299200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.559756:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147298816:12345-0@lo:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592631.559763:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788592631.559780:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147299200:12345-0@lo:400:kworker.0 Request processed in 52us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592631.559787:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788592631.559829:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788592631.559837:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147299072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.559867:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147299072:12345-0@lo:400:kworker.0 Request processed in 32us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592631.559873:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788592631.560012:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147299072:0@lo:400:kworker.0 00010000:00080000:1.0:1788592631.560028:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898193beea00 x1875475147299200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592631.560038:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147299200:0@lo:400:kworker.0 00000100:00100000:1.0:1788592631.560049:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147298688:0@lo:400:kworker.0 00000100:00080000:3.0:1788592631.560094:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788592631.560100:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592631.560103:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592631.560132:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147298816:0@lo:400:kworker.0 00010000:00080000:3.0:1788592631.560144:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898193bec000 x1875475147298944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592631.560151:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147298944:0@lo:400:kworker.0 00010000:00080000:3.0:1788592631.560159:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb24aa00 x1875475147298432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592631.560183:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147298432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592631.560811:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592631.562481:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592631.562691:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298304 00000100:00100000:2.0:1788592631.562702:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298304 00000100:00100000:2.0:1788592631.562808:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592631.562820:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147298304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592631.562872:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592631.562942:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147298560 00000100:00100000:3.0:1788592631.562948:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147298560 00000100:00100000:3.0:1788592631.562988:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788592631.562996:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147298560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592631.563056:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147298560:12345-0@lo:400:kworker.0 Request processed in 61us (2246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592631.563064:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788592631.563117:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147298304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 299us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592631.563124:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788592631.563562:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc186680 x1875475147298304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592647 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592631.563810:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc186680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147298304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592631.564085:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147298560:0@lo:400:kworker.0 00000001:00100000:2.0:1788592631.615828:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:2.0:1788592631.615839:0:6703:0:(genops.c:885:class_export_put()) final put ffff898084bc0800/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:0.0:1788592631.615923:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc0800/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-OST0000 00000020:00000080:0.0:1788592631.616066:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084bc4800 for lustre-OST0000 00000100:00100000:3.0:1788592631.787130:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592631.787185:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592631.787309:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782208 00000100:00100000:1.0:1788592631.787311:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782080 00000100:00100000:1.0:1788592631.787324:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782080 00000100:00100000:0.0:1788592631.787330:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782208 00000100:00100000:0.0:1788592631.787447:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:0.0:1788592631.787460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592631.787563:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592631.787572:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00080000:3.0:1788592631.787793:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592631.788493:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:1.0:1788592631.788505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782080:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592631.788561:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782080:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 59us (1444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592631.788569:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 198 00010000:00010000:3.0:1788592632.062588:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592633.087044:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592634.110829:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592634.348946:0:9233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:2.0:1788592635.134692:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592636.159571:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592636.671051:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147299456:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671133:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671191:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147299968:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671232:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671266:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788592636.671273:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147299328:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671303:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671325:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147299840:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671347:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671422:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147299584:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671457:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671480:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788592636.671485:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147299712:0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.671508:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592636.671538:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299328 00000100:00100000:3.0:1788592636.671546:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299328 00000100:00100000:3.0:1788592636.671610:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788592636.672223:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592636.672329:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147300096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592636.672399:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592636.672442:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299456 00000100:00100000:1.0:1788592636.672449:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299456 00000100:00100000:1.0:1788592636.672488:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299840 00000100:00100000:1.0:1788592636.672491:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299840 00000100:00100000:1.0:1788592636.672516:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299584 00000100:00100000:1.0:1788592636.672519:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299584 00000100:00100000:1.0:1788592636.672532:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788592636.672539:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147299456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.672602:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147299456:12345-0@lo:400:kworker.0 Request processed in 62us (1468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.672623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788592636.673099:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788592636.673109:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147299840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.673149:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147299840:12345-0@lo:400:kworker.0 Request processed in 42us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.673156:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788592636.673169:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788592636.673176:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147299584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.673203:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147299584:12345-0@lo:400:kworker.0 Request processed in 28us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.673209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592636.673569:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147299328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592636.673712:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147299328:12345-0@lo:400:kworker.0 Request processed in 2094us (2408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592636.673721:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788592636.673948:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299968 00000100:00100000:1.0:1788592636.673955:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299968 00000100:00100000:1.0:1788592636.673994:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147299712 00000100:00100000:1.0:1788592636.673998:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147299712 00000100:00100000:1.0:1788592636.674022:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592636.674029:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147299968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.674070:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147299968:12345-0@lo:400:kworker.0 Request processed in 42us (2838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.674076:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592636.674089:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592636.674094:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147299712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.674123:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147299712:12345-0@lo:400:kworker.0 Request processed in 29us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.674129:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592636.674165:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300096 00000100:00100000:1.0:1788592636.674169:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300096 00000100:00100000:1.0:1788592636.674196:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592636.674203:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147300096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592636.675009:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592636.675073:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147300096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 869us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.675083:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788592636.675126:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592636.675131:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592636.675134:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788592636.675182:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb24b100 x1875475147299712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592636.675196:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147299712:0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.675212:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147299584:0@lo:400:kworker.0 00000100:00100000:0.0:1788592636.676498:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147299328:0@lo:400:kworker.0 00000100:00100000:0.0:1788592636.676521:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147299840:0@lo:400:kworker.0 00000100:00100000:0.0:1788592636.676535:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147299456:0@lo:400:kworker.0 00010000:00080000:0.0:1788592636.676549:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb249f80 x1875475147299968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592636.676560:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147299968:0@lo:400:kworker.0 00000100:00100000:1.0:1788592636.677504:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592636.677521:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147300224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592636.677589:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592636.677663:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300224 00000100:00100000:1.0:1788592636.677670:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300224 00000100:00100000:1.0:1788592636.677730:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788592636.677741:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147300224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592636.677782:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:0.0:1788592636.678561:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc184a80 x1875475147300096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592636.678594:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147300096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592636.678911:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147300224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592636.678923:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788592636.678978:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898184e59f80 x1875475147300224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592652 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592636.678994:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147300224:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788592636.859115:0:9332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:2.0:1788592636.909447:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592636.909509:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592636.909551:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782464 00000100:00100000:2.0:1788592636.909561:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782464 00000100:00100000:2.0:1788592636.909642:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:2.0:1788592636.909655:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136782464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592636.909739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136782464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592636.909747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00080000:2.0:1788592636.909773:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592636.911471:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782336 00000100:00100000:3.0:1788592636.911489:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782336 00000100:00100000:3.0:1788592636.911568:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:3.0:1788592636.911579:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592636.911668:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (2235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592636.911677:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00010000:00010000:2.0:1788592637.182701:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592638.206761:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592639.235850:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592639.288023:0:9430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00010000:00010000:1.0:1788592640.254702:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592640.938653:0:9478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 03:17:18 EDT 2026 00010000:00010000:2.0:1788592641.278602:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592641.790725:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147300352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592641.790819:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592641.790949:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300352 00000100:00100000:1.0:1788592641.790958:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300352 00000100:00100000:1.0:1788592641.791045:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788592641.791056:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147300352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592641.791107:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592641.791162:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147300352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592641.791169:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788592641.791234:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc185880 x1875475147300352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592641.791254:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147300352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592641.791624:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592641.791634:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147300480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592641.791666:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592641.791699:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300480 00000100:00100000:1.0:1788592641.791703:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300480 00000100:00100000:1.0:1788592641.791738:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592641.791745:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147300480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592641.791767:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592641.791796:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147300480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592641.791820:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788592641.791851:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc185880 x1875475147300480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592641.791864:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147300480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592641.791983:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592641.791988:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592641.794637:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147300736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.794714:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592641.794780:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592641.794786:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147300608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.794820:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592641.794857:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147300992:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.794882:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592641.794903:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592641.794909:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147300864:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.794930:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592641.794962:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300736 00000100:00100000:2.0:1788592641.794971:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300736 00000100:00100000:0.0:1788592641.798523:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300992 00000100:00100000:0.0:1788592641.798551:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300992 00000100:00100000:0.0:1788592641.798617:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300864 00000100:00100000:0.0:1788592641.798621:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300864 00000100:00100000:0.0:1788592641.798645:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592641.798655:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147300736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592641.798764:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147300736:12345-0@lo:400:kworker.0 Request processed in 109us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592641.798772:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592641.798794:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788592641.798800:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147300992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592641.798838:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147300992:12345-0@lo:400:kworker.0 Request processed in 39us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592641.798845:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788592641.798859:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592641.798866:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147300864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592641.798896:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147300864:12345-0@lo:400:kworker.0 Request processed in 30us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592641.798914:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788592641.798936:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592641.799856:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147300608 00000100:00100000:1.0:1788592641.799865:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147300608 00000100:00100000:1.0:1788592641.799915:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788592641.799923:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147300608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592641.799981:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147300608:12345-0@lo:400:kworker.0 Request processed in 59us (5160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592641.799988:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788592641.801707:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147300864:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.801728:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147300992:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.801778:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147300608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592641.801793:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147300736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592642.022401:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592642.022518:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782592 00000100:00100000:3.0:1788592642.022540:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782592 00000100:00100000:3.0:1788592642.022621:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:3.0:1788592642.022633:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782592:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592642.022703:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782592:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 73us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592642.022711:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:2.0:1788592642.028080:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592642.028640:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782720 00000100:00100000:0.0:1788592642.028653:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782720 00000100:00100000:0.0:1788592642.028751:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1788592642.028770:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782720:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592642.028871:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 110us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592642.028880:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00080000:1.0:1788592642.029110:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592642.303765:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592643.326721:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592644.353533:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592645.376447:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592646.407657:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592646.911794:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147301120:0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.911880:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.911953:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147301632:0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.911986:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.912016:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592646.912022:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147301248:0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912047:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.912068:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147301760:0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912094:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.912145:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301632 00000100:00100000:0.0:1788592646.912155:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301632 00000100:00100000:0.0:1788592646.912217:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301248 00000100:00100000:0.0:1788592646.912220:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301248 00000100:00100000:0.0:1788592646.912243:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592646.912253:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147301632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912326:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147301632:12345-0@lo:400:kworker.0 Request processed in 74us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.912335:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788592646.912416:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592646.912423:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147301248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912463:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147301248:12345-0@lo:400:kworker.0 Request processed in 40us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.912470:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788592646.912490:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301760 00000100:00100000:0.0:1788592646.912494:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301760 00000100:00100000:0.0:1788592646.912526:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788592646.912533:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912563:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147301760:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.912569:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788592646.912585:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592646.912590:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592646.912627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147301248:0@lo:400:kworker.0 00010000:00080000:0.0:1788592646.912642:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15f800 x1875475147301760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592646.912652:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147301760:0@lo:400:kworker.0 00000100:00100000:0.0:1788592646.912661:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147301632:0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913255:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147301376:0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913298:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.913327:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592646.913333:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147301504:0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913380:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.913423:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301376 00000100:00100000:2.0:1788592646.913429:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301376 00000100:00100000:2.0:1788592646.913484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788592646.913490:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147301376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913544:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147301376:12345-0@lo:400:kworker.0 Request processed in 54us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.913552:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788592646.913576:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301504 00000100:00100000:2.0:1788592646.913579:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301504 00000100:00100000:2.0:1788592646.913607:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592646.913613:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147301504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913656:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147301504:12345-0@lo:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.913664:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788592646.913687:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592646.913691:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788592646.913714:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15d500 x1875475147301504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592646.913726:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147301504:0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.913736:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147301376:0@lo:400:kworker.0 00000100:00100000:3.0:1788592646.914159:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301120 00000100:00100000:3.0:1788592646.914173:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301120 00000100:00100000:3.0:1788592646.914217:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788592646.914225:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147301120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592646.914272:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147301120:12345-0@lo:400:kworker.0 Request processed in 49us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592646.914278:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788592646.914321:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147301120:0@lo:400:kworker.0 00000100:00100000:2.0:1788592646.919648:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592646.919676:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147301888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592646.919755:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592646.919812:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147301888 00000100:00100000:2.0:1788592646.919821:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147301888 00000100:00100000:2.0:1788592646.919877:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592646.919887:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147301888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592646.919927:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592646.919990:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147301888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592646.920015:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788592646.920474:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb362a00 x1875475147301888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592646.920496:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147301888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592646.921279:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147302016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592646.921337:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592646.925214:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302016 00000100:00100000:0.0:1788592646.925233:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302016 00000100:00100000:0.0:1788592646.925520:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592646.925541:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147302016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592646.925591:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592646.933239:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147302016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7690us (11889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592646.933256:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788592646.935088:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15c700 x1875475147302016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592646.935132:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147302016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592647.145787:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592647.146574:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782848 00000100:00100000:1.0:1788592647.146588:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782848 00000100:00100000:1.0:1788592647.146674:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:1.0:1788592647.146694:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592647.146796:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136782848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 102us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592647.150131:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:0.0:1788592647.152064:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592647.152387:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136782976 00000100:00100000:3.0:1788592647.152406:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136782976 00000100:00100000:3.0:1788592647.152512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592647.152524:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592647.152630:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136782976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 106us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592647.152639:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00080000:0.0:1788592647.152652:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788592647.422874:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592648.447137:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592649.472815:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592650.494758:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592651.529820:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592652.030639:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788592652.030742:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592652.030841:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592652.030848:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147302528:0@lo:400:kworker.0 00000100:00100000:1.0:1788592652.030876:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592652.031198:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302400 00000100:00100000:1.0:1788592652.031331:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302400 00000100:00100000:3.0:1788592652.031463:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147302144:0@lo:400:kworker.0 00000100:00100000:3.0:1788592652.031513:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592652.031538:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147302656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592652.031564:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592652.031583:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592652.031590:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147302272:0@lo:400:kworker.0 00000100:00100000:3.0:1788592652.031612:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592652.031630:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147302784:0@lo:400:kworker.0 00000100:00100000:3.0:1788592652.031654:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592652.031695:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302656 00000100:00100000:3.0:1788592652.031699:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302656 00000100:00100000:3.0:1788592652.031725:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302272 00000100:00100000:3.0:1788592652.031728:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302272 00000100:00100000:3.0:1788592652.031746:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592652.031756:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147302400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.031902:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302144 00000100:00100000:2.0:1788592652.031907:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302144 00000100:00100000:2.0:1788592652.032017:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788592652.032026:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147302144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.032069:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147302144:12345-0@lo:400:kworker.0 Request processed in 45us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592652.032076:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788592652.032276:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147303040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592652.032323:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592652.032378:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592652.032384:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147302912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592652.032636:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592652.032768:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303040 00000100:00100000:1.0:1788592652.032771:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788592652.032773:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303040 00000100:00100000:1.0:1788592652.032784:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147302656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.032808:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302912 00000100:00100000:2.0:1788592652.032811:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302912 00000100:00100000:2.0:1788592652.032833:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592652.032842:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147303040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592652.032844:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147302656:12345-0@lo:400:kworker.0 Request processed in 67us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592652.032852:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592652.032867:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592652.032873:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147302272:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1788592652.032877:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592652.032906:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147302272:12345-0@lo:400:kworker.0 Request processed in 32us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592652.032911:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0517b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147303040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592652.032917:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592652.032923:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592652.032943:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302528 00000100:00100000:1.0:1788592652.032948:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302528 00000100:00100000:2.0:1788592652.033011:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788592652.033022:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147302912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592652.033042:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592652.033072:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0517100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147302912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592652.033077:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788592652.034100:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb363800 x1875475147302912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592652.034125:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb363800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147302912:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788592652.034140:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc1e4e00 x1875475147303040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592668 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592652.034152:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147303040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592652.034292:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147302272:0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.034306:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147302144:0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.034317:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc184e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147302656:0@lo:400:kworker.0 00000100:00100000:2.0:1788592652.035076:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147302784 00000100:00100000:2.0:1788592652.035095:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147302784 00000100:00100000:2.0:1788592652.035162:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592652.035173:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147302784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592652.035602:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147302400:12345-0@lo:400:kworker.0 Request processed in 3845us (4858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592652.035613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592652.035993:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147302784:12345-0@lo:400:kworker.0 Request processed in 822us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592652.035999:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788592652.036070:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc187480 x1875475147302784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592652.036083:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147302784:0@lo:400:kworker.0 00000100:00080000:1.0:1788592652.036689:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592652.036768:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592652.036772:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592652.036813:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788592652.036960:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592652.036972:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147302528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592652.037045:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147302528:12345-0@lo:400:kworker.0 Request processed in 76us (6168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592652.037063:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788592652.037134:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc185f80 x1875475147302528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592652.037147:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147302528:0@lo:400:kworker.0 00000100:00100000:0.0:1788592652.267890:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592652.267954:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592652.267991:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783104 00000100:00100000:0.0:1788592652.268002:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783104 00000100:00100000:0.0:1788592652.268066:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:0.0:1788592652.268077:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136783104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592652.268155:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136783104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592652.268163:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:1.0:1788592652.268791:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783232 00000100:00100000:1.0:1788592652.268799:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783232 00000100:00100000:1.0:1788592652.268867:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1788592652.268875:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136783232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592652.268925:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136783232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 50us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592652.268962:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00080000:0.0:1788592652.269416:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592652.543278:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592653.567540:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592654.591476:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592655.615004:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592656.638996:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592657.151518:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147303168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592657.151619:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592657.151722:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303168 00000100:00100000:2.0:1788592657.151730:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303168 00000100:00100000:2.0:1788592657.151796:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592657.151807:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147303168:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592657.152009:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147303296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592657.152046:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788592657.152182:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592657.152256:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147303168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 450us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592657.152264:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788592657.152282:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303296 00000100:00100000:2.0:1788592657.152287:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303296 00000100:00100000:2.0:1788592657.152306:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592657.152312:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147303296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592657.152333:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592657.152392:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147303296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592657.152398:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592657.152482:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147303424:0@lo:400:kworker.0 00000100:00100000:2.0:1788592657.152536:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592657.152715:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147303680:0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.152750:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788592657.152792:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981a0515180 x1875475147303168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592657.152813:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147303168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592657.152829:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592657.152835:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147303808:0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.152871:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592657.152899:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303680 00000100:00100000:1.0:1788592657.152904:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303680 00000100:00100000:1.0:1788592657.152936:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303808 00000100:00100000:1.0:1788592657.152938:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303808 00000100:00100000:1.0:1788592657.152957:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592657.152965:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147303680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.153004:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147303680:12345-0@lo:400:kworker.0 Request processed in 40us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592657.153019:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788592657.153040:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592657.153046:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147303808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.153075:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147303808:12345-0@lo:400:kworker.0 Request processed in 30us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592657.153082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788592657.153120:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc185180 x1875475147303296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592673 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592657.153136:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147303296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592657.153162:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147303808:0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.153171:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147303680:0@lo:400:kworker.0 00000100:00080000:1.0:1788592657.153530:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592657.153537:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592657.153540:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592657.154834:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592657.154860:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147303552:0@lo:400:kworker.0 00000100:00100000:2.0:1788592657.155310:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592657.155402:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303424 00000100:00100000:2.0:1788592657.155411:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303424 00000100:00100000:2.0:1788592657.155470:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788592657.155480:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147303424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592657.155503:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303552 00000100:00100000:1.0:1788592657.155508:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303552 00000100:00100000:2.0:1788592657.155537:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147303424:12345-0@lo:400:kworker.0 Request processed in 58us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592657.155537:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788592657.155544:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147303552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592657.155545:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788592657.155583:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0516680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147303552:12345-0@lo:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592657.155588:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788592657.155597:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147303552:0@lo:400:kworker.0 00000100:00100000:2.0:1788592657.155608:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0514e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147303424:0@lo:400:kworker.0 00000100:00100000:0.0:1788592657.394231:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592657.394383:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592657.394474:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783488 00000100:00100000:1.0:1788592657.394486:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783488 00000100:00100000:1.0:1788592657.394574:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1788592657.394587:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136783488:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592657.394719:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136783488:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 135us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592657.394728:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00080000:0.0:1788592657.396645:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592657.400086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783360 00000100:00100000:3.0:1788592657.400113:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783360 00000100:00100000:3.0:1788592657.400803:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:3.0:1788592657.400819:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136783360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592657.400928:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2342:x1875475136783360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 113us (6717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592657.400937:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 208 00000001:02000400:3.0:1788592657.522773:0:10107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:17:35 (1788592655) === 00010000:00010000:3.0:1788592657.662612:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592658.055509:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.055671:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783616 00000100:00100000:0.0:1788592658.055686:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783616 00000100:00100000:0.0:1788592658.055760:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:0.0:1788592658.055773:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+10:8135:x1875475136783616:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592658.055794:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592658.055828:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bccca400/0x27b316f132510a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1908 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.055889:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca400/0x27b316f132510a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1908 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.055904:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bccca400/0x27b316f132510a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1908 expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.055916:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca400, rc 0) 00000100:00100000:0.0:1788592658.055995:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136783616:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 225us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.056002:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:1.0:1788592658.062890:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592658.063043:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783744 00000100:00100000:3.0:1788592658.063055:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783744 00000100:00100000:3.0:1788592658.063122:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:3.0:1788592658.063133:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136783744:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788592658.063649:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136783744:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 514us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.063658:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:1.0:1788592658.067664:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592658.067758:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136783872 00000100:00100000:3.0:1788592658.067771:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136783872 00000100:00100000:3.0:1788592658.067844:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:3.0:1788592658.067855:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136783872:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788592658.068149:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136783872:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 295us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.068159:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:2.0:1788592658.079024:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.079191:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784000 00000100:00100000:0.0:1788592658.079203:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784000 00000100:00100000:0.0:1788592658.079275:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:0.0:1788592658.079287:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8139:x1875475136784000:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592658.079945:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8139:x1875475136784000:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 657us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.079954:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:1.0:1788592658.112815:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.113017:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784128 00000100:00100000:0.0:1788592658.113031:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784128 00000100:00100000:0.0:1788592658.113100:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:0.0:1788592658.113112:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8139:x1875475136784128:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592658.114245:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8139:x1875475136784128:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 1127us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.114258:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:1.0:1788592658.123575:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.123696:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784256 00000100:00100000:0.0:1788592658.123724:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784256 00000100:00100000:0.0:1788592658.123790:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:0.0:1788592658.123802:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+11:8135:x1875475136784256:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592658.123932:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592658.123955:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccb000/0x27b316f132510aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1932 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.123993:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccb000/0x27b316f132510aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1932 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.124006:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccb000/0x27b316f132510aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1932 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.124017:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb000, rc 0) 00000100:00100000:0.0:1788592658.124193:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:8135:x1875475136784256:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 392us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.124201:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:2.0:1788592658.144892:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.149252:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784384 00000100:00100000:0.0:1788592658.149277:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784384 00000100:00100000:0.0:1788592658.149868:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:0.0:1788592658.149883:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:8135:x1875475136784384:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788592658.149914:0:5815:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788592658.150016:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788592658.150021:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788592658.150025:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788592658.150028:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788592658.160698:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:8135:x1875475136784384:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 10794us (15799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.160738:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:1.0:1788592658.171052:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.172791:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784512 00000100:00100000:0.0:1788592658.172816:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784512 00000100:00100000:0.0:1788592658.172900:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:0.0:1788592658.172910:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:8135:x1875475136784512:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592658.172931:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592658.172953:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1939 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.172989:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.173007:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592658.173017:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca000, rc 0) 00000100:00100000:0.0:1788592658.173234:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8135:x1875475136784512:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 323us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.173242:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:2.0:1788592658.176184:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.176527:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784640 00000100:00100000:0.0:1788592658.176541:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784640 00000100:00100000:0.0:1788592658.176614:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:0.0:1788592658.176627:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8135:x1875475136784640:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592658.177673:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8135:x1875475136784640:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 1040us (1492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.177684:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:1.0:1788592658.184977:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.192318:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784768 00000100:00100000:0.0:1788592658.192340:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784768 00000100:00100000:0.0:1788592658.192619:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:0.0:1788592658.192632:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8135:x1875475136784768:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788592658.193699:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8135:x1875475136784768:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 1060us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.193712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:1.0:1788592658.211738:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.211948:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136784896 00000100:00100000:0.0:1788592658.211961:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136784896 00000100:00100000:0.0:1788592658.212094:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:0.0:1788592658.212107:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8143:x1875475136784896:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592658.212561:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8143:x1875475136784896:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 452us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.212571:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:2.0:1788592658.221047:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.221156:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785024 00000100:00100000:0.0:1788592658.221170:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785024 00000100:00100000:0.0:1788592658.221247:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:0.0:1788592658.221259:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8143:x1875475136785024:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592658.221631:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:8143:x1875475136785024:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 364us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.221640:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:1.0:1788592658.225912:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592658.225969:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592658.226071:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785152 00000100:00100000:3.0:1788592658.226093:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785152 00000100:00100000:3.0:1788592658.226145:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785536 00000100:00100000:3.0:1788592658.226148:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785536 00000100:00100000:3.0:1788592658.226197:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1788592658.226208:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136785536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592658.226318:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136785536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 111us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.226326:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1788592658.226390:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1788592658.226414:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1875475136785152:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788592658.226441:0:5822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3e4db69f-98e2-4e24-80ee-276a360c1356@192.168.204.20@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788592658.226487:0:5822:0:(genops.c:1385:class_connect()) connect: client 3e4db69f-98e2-4e24-80ee-276a360c1356, cookie 0x27b316f132510ab0 00000004:00100000:3.0:1788592658.226529:0:5822:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1788592658.227040:0:5822:0:(import.c:65:import_set_state_nolock()) ffff898084345000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592658.227087:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2340:x1875475136785152:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 671us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.227096:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1788592658.234901:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592658.235022:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.235143:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785280 00000100:00100000:0.0:1788592658.235157:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785280 00000100:00100000:0.0:1788592658.235255:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785408 00000100:00100000:0.0:1788592658.235258:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785408 00000100:00100000:0.0:1788592658.235287:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:0.0:1788592658.235320:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+7:0:x1875475136785280:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788592658.235416:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788592658.235708:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+7:0:x1875475136785280:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 370us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.235724:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1788592658.235747:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1788592658.235764:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136785408:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788592658.235784:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788592658.235849:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136785408:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 91us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.235858:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:1.0:1788592658.235944:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592658.238228:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592658.240200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785664 00000100:00100000:0.0:1788592658.240238:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785664 00000100:00100000:0.0:1788592658.240334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1788592658.240394:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136785664:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788592658.240521:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0514e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136785664:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 175us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.240533:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1788592658.250716:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592658.250758:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592658.250799:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592658.250928:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785792 00000100:00100000:3.0:1788592658.250941:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785792 00000100:00100000:3.0:1788592658.250994:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136785920 00000100:00100000:3.0:1788592658.250997:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136785920 00000100:00100000:3.0:1788592658.251018:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1788592658.251027:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875475136785792:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788592658.251065:0:8688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3e4db69f-98e2-4e24-80ee-276a360c1356@192.168.204.20@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788592658.251110:0:8688:0:(genops.c:1385:class_connect()) connect: client 3e4db69f-98e2-4e24-80ee-276a360c1356, cookie 0x27b316f132510ab7 00002000:00100000:3.0:1788592658.251125:0:8688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e4db69f-98e2-4e24-80ee-276a360c1356/ffff898084347800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592658.251141:0:8688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788592658.251533:0:8688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788592658.251571:0:8688:0:(import.c:65:import_set_state_nolock()) ffff898084344000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592658.251655:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2340:x1875475136785792:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 627us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.251664:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1788592658.251685:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592658.251689:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875475136785920:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788592658.251707:0:8688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3e4db69f-98e2-4e24-80ee-276a360c1356@192.168.204.20@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1788592658.251724:0:8688:0:(genops.c:1385:class_connect()) connect: client 3e4db69f-98e2-4e24-80ee-276a360c1356, cookie 0x27b316f132510abe 00002000:00100000:3.0:1788592658.251730:0:8688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e4db69f-98e2-4e24-80ee-276a360c1356/ffff898084341000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592658.251737:0:8688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788592658.251880:0:8688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788592658.251897:0:8688:0:(import.c:65:import_set_state_nolock()) ffff898084347000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592658.251923:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2340:x1875475136785920:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 232us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592658.251931:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1788592658.253676:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786048 00000100:00100000:0.0:1788592658.253694:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786048 00000100:00100000:0.0:1788592658.253760:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1788592658.253770:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136786048:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788592658.253874:0:5825:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788592658.254005:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:8135:x1875475136786048:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 236us (3304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592658.254014:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00010000:00010000:3.0:1788592658.686863:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592659.710505:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592660.740105:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592661.759613:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592661.859631:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00000001:00100000:2.0:1788592661.859961:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00000100:00100000:2.0:1788592662.272455:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147303936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592662.272551:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592662.272631:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592662.272638:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147304064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592662.272663:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592662.272796:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147303936 00000100:00100000:2.0:1788592662.272807:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147303936 00000100:00100000:2.0:1788592662.272860:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304064 00000100:00100000:2.0:1788592662.272863:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304064 00000100:00100000:2.0:1788592662.272881:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592662.272889:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147303936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592662.272941:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592662.273004:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0516a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147303936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592662.273011:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592662.273028:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592662.273034:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147304064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592662.273052:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788592662.273204:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788592662.273209:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592662.274909:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147304192:0@lo:400:kworker.0 00000100:00100000:0.0:1788592662.274998:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592662.275049:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592662.275405:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147304064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2369us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592662.275413:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788592662.275447:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147304448:0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275479:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788592662.275518:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981a0517480 x1875475147304064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592662.275541:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147304064:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788592662.275555:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15d180 x1875475147303936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592662.275566:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147303936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592662.275587:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592662.275608:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147304576:0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275631:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592662.275660:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304448 00000100:00100000:2.0:1788592662.275667:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304448 00000100:00100000:2.0:1788592662.275716:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304576 00000100:00100000:2.0:1788592662.275719:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304576 00000100:00100000:2.0:1788592662.275743:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592662.275750:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147304448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275792:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147304448:12345-0@lo:400:kworker.0 Request processed in 42us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592662.275799:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592662.275811:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592662.275817:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147304576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275842:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147304576:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592662.275848:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788592662.275867:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592662.275885:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147304576:0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275895:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147304448:0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.275961:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304192 00000100:00100000:2.0:1788592662.275965:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304192 00000100:00100000:2.0:1788592662.276008:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788592662.276015:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147304192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592662.276044:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147304192:12345-0@lo:400:kworker.0 Request processed in 30us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592662.276051:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788592662.278785:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147304320:0@lo:400:kworker.0 00000100:00100000:0.0:1788592662.279460:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592662.279507:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304320 00000100:00100000:0.0:1788592662.279517:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304320 00000100:00100000:0.0:1788592662.279572:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788592662.279582:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147304320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592662.279636:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147304320:12345-0@lo:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592662.279644:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788592662.279696:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147304320:0@lo:400:kworker.0 00000100:00100000:0.0:1788592662.279710:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147304192:0@lo:400:kworker.0 00000001:00100000:3.0:1788592662.364861:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00010000:00010000:1.0:1788592662.782728:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592663.523598:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592663.523698:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786176 00000100:00100000:3.0:1788592663.523711:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786176 00000100:00100000:3.0:1788592663.523774:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:3.0:1788592663.523787:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136786176:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592663.523881:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136786176:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 97us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592663.523911:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:0.0:1788592663.526502:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592663.526604:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592663.526632:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592663.526690:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786560 00000100:00100000:3.0:1788592663.526703:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786560 00000100:00100000:3.0:1788592663.526788:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1788592663.526798:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786560:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:1.0:1788592663.526822:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592663.526885:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786560:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592663.526892:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1788592663.527071:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592663.527095:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786688 00000100:00100000:0.0:1788592663.527100:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786688 00000100:00100000:0.0:1788592663.527150:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1788592663.527266:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786688:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592663.527306:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786688:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 149us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592663.527312:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00080000:0.0:1788592663.527332:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592663.528778:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786304 00000100:00100000:2.0:1788592663.528792:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786304 00000100:00100000:2.0:1788592663.528875:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786432 00000100:00100000:2.0:1788592663.528879:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786432 00000100:00100000:2.0:1788592663.528913:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1788592663.528923:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136786304:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592663.528999:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136786304:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 78us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592663.529007:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1788592663.529023:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1788592663.529030:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786432:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592663.529085:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136786432:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592663.529093:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:0.0:1788592663.529438:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592663.815555:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592664.218923:0:10304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788592664.830617:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592665.861322:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592666.882391:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592667.390797:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592667.390820:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147304704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592667.390900:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592667.390982:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304704 00000100:00100000:3.0:1788592667.390991:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304704 00000100:00100000:3.0:1788592667.391089:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592667.391101:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147304704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592667.391142:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592667.391194:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147304704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592667.391202:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788592667.391225:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788592667.391270:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15df80 x1875475147304704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592667.391288:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147304704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592667.391906:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592667.391919:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147304832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592667.391964:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592667.392117:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304832 00000100:00100000:1.0:1788592667.392123:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304832 00000100:00100000:1.0:1788592667.392184:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788592667.392193:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147304832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592667.392224:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592667.392281:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147304832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592667.392287:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788592667.392328:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb24b100 x1875475147304832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592683 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592667.392343:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147304832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592667.392597:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147304960:0@lo:400:kworker.0 00000100:00100000:3.0:1788592667.392637:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592667.392793:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592667.392799:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147305088:0@lo:400:kworker.0 00000100:00100000:3.0:1788592667.392830:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592667.392865:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147304960 00000100:00100000:3.0:1788592667.392870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147304960 00000100:00100000:3.0:1788592667.392902:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788592667.392909:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147304960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592667.392946:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147304960:12345-0@lo:400:kworker.0 Request processed in 37us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592667.392953:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788592667.392986:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305088 00000100:00100000:3.0:1788592667.392990:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305088 00000100:00100000:3.0:1788592667.393098:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788592667.393107:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147305088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592667.393140:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147305088:12345-0@lo:400:kworker.0 Request processed in 36us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592667.393148:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788592667.393183:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147305088:0@lo:400:kworker.0 00000100:00100000:3.0:1788592667.393193:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0516300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147304960:0@lo:400:kworker.0 00000100:00100000:2.0:1788592667.393291:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147305344:0@lo:400:kworker.0 00000100:00100000:2.0:1788592667.393326:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592667.393383:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592667.393390:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147305216:0@lo:400:kworker.0 00000100:00100000:2.0:1788592667.393414:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592667.393781:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592667.393843:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305344 00000100:00100000:1.0:1788592667.393849:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305344 00000100:00100000:1.0:1788592667.393900:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305216 00000100:00100000:1.0:1788592667.393904:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305216 00000100:00100000:1.0:1788592667.393927:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592667.393935:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147305344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592667.393987:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147305344:12345-0@lo:400:kworker.0 Request processed in 53us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592667.393994:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592667.394102:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592667.394109:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147305216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592667.394141:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0514a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147305216:12345-0@lo:400:kworker.0 Request processed in 34us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592667.394148:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592667.394605:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147305216:0@lo:400:kworker.0 00000100:00100000:1.0:1788592667.394619:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147305344:0@lo:400:kworker.0 00000100:00080000:0.0:1788592667.394783:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592667.902501:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592668.649042:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592668.649096:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592668.649147:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592668.649174:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592668.649202:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592668.649238:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787328 00000100:00100000:0.0:1788592668.649249:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787328 00000100:00100000:0.0:1788592668.649322:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787200 00000100:00100000:0.0:1788592668.649326:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787200 00000100:00100000:0.0:1788592668.649394:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1788592668.649407:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787328:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592668.649491:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787328:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592668.649498:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1788592668.649518:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1788592668.649525:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787200:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592668.649566:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787200:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592668.649573:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1788592668.649594:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787072 00000100:00100000:0.0:1788592668.649598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787072 00000100:00100000:0.0:1788592668.649627:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786944 00000100:00100000:0.0:1788592668.649630:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786944 00000100:00100000:0.0:1788592668.649653:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1788592668.649660:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787072:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592668.649713:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136787072:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 54us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592668.649721:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1788592668.649735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1788592668.649742:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136786944:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592668.649767:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136786944:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592668.649774:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00080000:0.0:1788592668.649796:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592668.649802:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592668.649804:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592668.650790:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136786816 00000100:00100000:2.0:1788592668.650799:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136786816 00000100:00100000:2.0:1788592668.650857:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:2.0:1788592668.650865:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136786816:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592668.650925:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136786816:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 60us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592668.650933:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00010000:00010000:1.0:1788592668.928011:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592669.953304:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592670.976489:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592671.998733:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592672.510997:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592672.511024:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147305472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592672.511118:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.511162:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305472 00000100:00100000:1.0:1788592672.511173:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305472 00000100:00100000:1.0:1788592672.511336:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788592672.511347:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147305472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592672.511404:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788592672.511737:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592672.511751:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147305472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 405us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592672.511751:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147305728:0@lo:400:kworker.0 00000100:00100000:1.0:1788592672.511760:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788592672.511785:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592672.511807:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592672.511812:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305728 00000100:00100000:0.0:1788592672.511814:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147305856:0@lo:400:kworker.0 00000100:00100000:1.0:1788592672.511816:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305728 00000100:00100000:1.0:1788592672.511845:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788592672.511852:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147305728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592672.511862:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.511979:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147305728:12345-0@lo:400:kworker.0 Request processed in 126us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592672.511986:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788592672.511998:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305856 00000100:00100000:1.0:1788592672.512001:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305856 00000100:00080000:2.0:1788592672.512027:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592672.512030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592672.512037:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147305856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.512050:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147305600:0@lo:400:kworker.0 00000100:00100000:1.0:1788592672.512079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147305856:12345-0@lo:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.512084:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.512086:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788592672.512108:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147306112:0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.512130:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788592672.512168:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15df80 x1875475147305472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592672.512188:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147305472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592672.512200:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306112 00000100:00100000:1.0:1788592672.512204:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306112 00000100:00100000:2.0:1788592672.512218:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592672.512224:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147305984:0@lo:400:kworker.0 00000100:00100000:1.0:1788592672.512228:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788592672.512252:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592672.512634:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147306112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592672.512680:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0514700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147306112:12345-0@lo:400:kworker.0 Request processed in 49us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.521511:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147306240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592672.521605:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592672.521681:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147305856:0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.521697:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147305728:0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.521751:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305600 00000100:00100000:2.0:1788592672.521758:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305600 00000100:00100000:2.0:1788592672.521805:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788592672.521814:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147305600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.521869:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147305600:12345-0@lo:400:kworker.0 Request processed in 56us (9784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.521878:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:2.0:1788592672.521932:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592672.521968:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147305600:0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.522007:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147306112:0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.522041:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147305984 00000100:00100000:2.0:1788592672.522045:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147305984 00000100:00100000:2.0:1788592672.522092:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788592672.522099:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147305984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592672.522137:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147305984:12345-0@lo:400:kworker.0 Request processed in 39us (9885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592672.522144:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788592672.522160:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592672.522176:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788592672.522177:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf485c00 x1875475147305984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592672.522188:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147305984:0@lo:400:kworker.0 00000100:00100000:3.0:1788592672.530032:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306240 00000100:00100000:3.0:1788592672.530052:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306240 00000100:00100000:3.0:1788592672.530397:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592672.530412:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147306240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592672.530468:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592672.530738:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0516300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147306240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 329us (9132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592672.530747:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788592672.530811:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981a0517800 x1875475147306240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592688 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592672.530833:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147306240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788592673.027927:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592673.770400:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592673.770441:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592673.770465:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592673.770486:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592673.770509:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592673.770551:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787968 00000100:00100000:0.0:1788592673.770563:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787968 00000100:00100000:0.0:1788592673.770847:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787840 00000100:00100000:0.0:1788592673.770852:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787840 00000100:00100000:0.0:1788592673.770886:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1788592673.770915:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787968:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592673.771010:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787968:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 98us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592673.771018:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1788592673.771038:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1788592673.771045:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787840:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592673.771069:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787840:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592673.771074:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1788592673.771500:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787456 00000100:00100000:2.0:1788592673.771506:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787456 00000100:00100000:2.0:1788592673.771549:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:2.0:1788592673.771557:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2343:x1875475136787456:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592673.771589:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2343:x1875475136787456:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592673.771595:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:2.0:1788592673.771640:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787712 00000100:00100000:2.0:1788592673.771645:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787712 00000100:00100000:2.0:1788592673.771672:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136787584 00000100:00100000:2.0:1788592673.771675:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136787584 00000100:00100000:2.0:1788592673.771706:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1788592673.771713:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787712:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592673.771756:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136787712:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 43us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592673.771763:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:2.0:1788592673.771895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1788592673.771906:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136787584:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592673.771946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136787584:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 42us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592673.771952:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00080000:2.0:1788592673.771974:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592673.771978:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592673.771981:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788592674.047221:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592675.070798:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592676.095603:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592677.120936:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592677.631063:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592677.631094:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147306368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592677.631178:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592677.631295:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306368 00000100:00100000:2.0:1788592677.631306:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306368 00000100:00100000:2.0:1788592677.631405:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788592677.631415:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147306368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592677.631467:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592677.631527:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147306368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.631535:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788592677.631581:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981a0514380 x1875475147306368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.631600:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147306368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788592677.631896:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592677.632049:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147306624:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632087:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592677.632109:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788592677.632131:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147306496:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632163:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592677.632187:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147307008:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632212:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592677.632245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306624 00000100:00100000:2.0:1788592677.632251:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306624 00000100:00100000:2.0:1788592677.632285:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788592677.632293:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147306624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632333:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147306624:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.632340:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788592677.632387:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306496 00000100:00100000:2.0:1788592677.632391:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306496 00000100:00100000:2.0:1788592677.632416:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788592677.632422:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147306496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632465:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147306496:12345-0@lo:400:kworker.0 Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.632471:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788592677.632506:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307008 00000100:00100000:2.0:1788592677.632510:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307008 00000100:00100000:2.0:1788592677.632542:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592677.632548:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147307008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632574:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147307008:12345-0@lo:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.632579:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788592677.632605:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147306880:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.632639:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592677.632658:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592677.632663:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147306752:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.633247:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.636478:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592677.636506:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147307136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592677.636598:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592677.636657:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307136 00000100:00100000:3.0:1788592677.636667:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307136 00000100:00100000:3.0:1788592677.636719:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592677.636728:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147307136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592677.636767:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592677.636813:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147307136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592677.636820:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788592677.636886:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15ea00 x1875475147307136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592677.637063:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306880 00000100:00100000:2.0:1788592677.637069:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306880 00000100:00100000:2.0:1788592677.637105:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147306752 00000100:00100000:2.0:1788592677.637108:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147306752 00000100:00100000:2.0:1788592677.637131:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788592677.637139:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147306880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.637180:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147306880:12345-0@lo:400:kworker.0 Request processed in 42us (4540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.637187:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788592677.637199:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788592677.637205:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147306752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.637234:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147306752:12345-0@lo:400:kworker.0 Request processed in 29us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592677.637242:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788592677.637245:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147307136:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788592677.637271:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592677.637277:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592677.637310:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0514380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147306496:0@lo:400:kworker.0 00010000:00080000:3.0:1788592677.637324:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898183e99880 x1875475147307008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592677.637334:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147307008:0@lo:400:kworker.0 00000100:00100000:3.0:1788592677.637346:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0516d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147306624:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.637910:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0515180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147306752:0@lo:400:kworker.0 00000100:00100000:2.0:1788592677.637924:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147306880:0@lo:400:kworker.0 00010000:00010000:1.0:1788592678.149240:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592678.884437:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592678.884485:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592678.884509:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592678.884530:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592678.884567:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592678.884596:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788352 00000100:00100000:2.0:1788592678.884609:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788352 00000100:00100000:3.0:1788592678.884622:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788096 00000100:00100000:3.0:1788592678.884626:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788096 00000100:00100000:2.0:1788592678.884668:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788224 00000100:00100000:2.0:1788592678.884671:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788224 00000100:00100000:3.0:1788592678.884674:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:3.0:1788592678.884684:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136788096:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592678.884692:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1788592678.884699:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136788352:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592678.884760:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136788352:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 62us (274us total) trans 0 rc 0/0 00000100:00080000:0.0:1788592678.884762:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592678.884769:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1788592678.884787:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1788592678.884956:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136788096:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 272us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592678.884965:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:3.0:1788592678.885018:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788480 00000100:00100000:3.0:1788592678.885022:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788480 00000100:00100000:3.0:1788592678.885099:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788608 00000100:00100000:3.0:1788592678.885103:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788608 00000100:00100000:2.0:1788592678.885145:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136788224:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592678.885175:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136788224:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 382us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592678.885181:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:2.0:1788592678.885760:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1788592678.885771:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2340:x1875475136788480:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:2.0:1788592678.885796:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510ab7 00000100:00080000:2.0:1788592678.885807:0:6676:0:(import.c:65:import_set_state_nolock()) ffff898084344000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788592678.885861:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788592678.886230:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+2:2340:x1875475136788480:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 460us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592678.886238:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:2.0:1788592678.886259:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788592678.886799:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592678.886805:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592678.887731:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592678.887746:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2340:x1875475136788608:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1788592678.887783:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510abe 00000100:00080000:3.0:1788592678.887795:0:6677:0:(import.c:65:import_set_state_nolock()) ffff898084347000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592678.887861:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788592678.888195:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+2:2340:x1875475136788608:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 452us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592678.888216:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:1.0:1788592678.888700:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592679.167543:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592680.191629:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592681.214940:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788592682.211921:0:11006:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788592682.240912:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592682.404468:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00000020:00000080:0.0:1788592682.404481:0:7632:0:(genops.c:885:class_export_put()) final put ffff898084341000/3e4db69f-98e2-4e24-80ee-276a360c1356 00000020:00000080:3.0:1788592682.406330:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff898084341000/3e4db69f-98e2-4e24-80ee-276a360c1356 for lustre-OST0001 00000020:00000080:3.0:1788592682.406441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084347000 for lustre-OST0001 00000100:00100000:2.0:1788592682.750837:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147307264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592682.750920:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147307520:0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.750941:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592682.750963:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592682.751025:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307264 00000100:00100000:2.0:1788592682.751033:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307264 00000100:00100000:2.0:1788592682.751123:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592682.751134:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147307264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592682.751452:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592682.751517:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147307264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 384us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.751526:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592682.751561:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307520 00000100:00100000:2.0:1788592682.751565:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307520 00000100:00100000:2.0:1788592682.751604:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788592682.751612:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147307520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.751649:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147307520:12345-0@lo:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.751655:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788592682.751672:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592682.751766:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147307648:0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.751800:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592682.751827:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307648 00000100:00100000:2.0:1788592682.751830:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307648 00000100:00100000:2.0:1788592682.751877:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788592682.751883:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147307648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.751916:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147307648:12345-0@lo:400:kworker.0 Request processed in 33us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.751939:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788592682.751957:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592682.752110:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147307392:0@lo:400:kworker.0 00000100:00100000:1.0:1788592682.752155:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592682.752542:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307392 00000100:00100000:2.0:1788592682.752548:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307392 00000100:00100000:2.0:1788592682.752585:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788592682.752593:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147307392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.752635:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3284:x1875475147307392:12345-0@lo:400:kworker.0 Request processed in 44us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.752642:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00080000:0.0:1788592682.753832:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf487b80 x1875475147307264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592682.753863:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147307264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592682.753902:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147307776:0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.753955:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592682.754018:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147307520:0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.754039:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147308032:0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.754068:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592682.754097:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592682.754106:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147308160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592682.754136:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592682.754169:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307776 00000100:00100000:0.0:1788592682.754176:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307776 00000100:00100000:2.0:1788592682.754214:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308032 00000100:00100000:0.0:1788592682.754231:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788592682.754240:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147307776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.754283:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147307776:12345-0@lo:400:kworker.0 Request processed in 45us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592682.754291:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788592682.754321:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf484e00 x1875475147307776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592682.754332:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147307776:0@lo:400:kworker.0 00000100:00080000:0.0:1788592682.754385:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592682.754398:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308160 00000100:00100000:0.0:1788592682.754402:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308160 00000100:00100000:0.0:1788592682.754426:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788592682.754431:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147308160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592682.754460:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592682.754497:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147308160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592682.754503:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788592682.754525:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc90d180 x1875475147308160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592682.754552:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147308160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592682.754558:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308032 00000100:00100000:2.0:1788592682.754603:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788592682.754613:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147308032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.754660:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147307392:0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.754666:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf486680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147308032:12345-0@lo:400:kworker.0 Request processed in 53us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592682.754673:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147307904:0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.754680:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788592682.754710:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf484380 x1875475147308032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592682.754717:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592682.754729:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788592682.754769:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147307904 00000100:00100000:2.0:1788592682.754773:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147307904 00000100:00100000:2.0:1788592682.754810:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788592682.754818:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147307904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788592682.754819:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592682.754875:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147307904:12345-0@lo:400:kworker.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592682.754883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788592682.754917:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147307648:0@lo:400:kworker.0 00000100:00100000:0.0:1788592682.754995:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147307904:0@lo:400:kworker.0 00000001:00100000:1.0:1788592682.777030:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00000020:00000080:1.0:1788592682.777041:0:6703:0:(genops.c:885:class_export_put()) final put ffff898084347800/3e4db69f-98e2-4e24-80ee-276a360c1356 00000020:00000080:2.0:1788592682.777116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff898084347800/3e4db69f-98e2-4e24-80ee-276a360c1356 for lustre-OST0000 00000020:00000080:2.0:1788592682.777177:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084344000 for lustre-OST0000 00010000:00010000:0.0:1788592683.265493:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592684.006649:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592684.006691:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592684.006734:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592684.006767:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788992 00000100:00100000:2.0:1788592684.006778:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788992 00000100:00100000:2.0:1788592684.006846:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788864 00000100:00100000:2.0:1788592684.006849:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788864 00000100:00100000:2.0:1788592684.006874:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1788592684.006886:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136788992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592684.006971:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136788992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592684.006979:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:2.0:1788592684.006999:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:2.0:1788592684.007005:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136788864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592684.007029:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136788864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592684.007034:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00080000:2.0:1788592684.007052:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592684.007599:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136788736 00000100:00100000:0.0:1788592684.007606:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136788736 00000100:00100000:0.0:1788592684.007649:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:0.0:1788592684.007657:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136788736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592684.007695:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136788736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592684.007702:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00010000:00010000:2.0:1788592684.287506:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592685.312572:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788592686.323264:0:11157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe80393240 20000000:00000080:3.0:1788592686.323292:0:11157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8981bc5a8000 uarg=0000000000000000 20000000:01000000:3.0:1788592686.323340:0:11157:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592686.323485:0:11157:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592686.323492:0:11157:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788592686.325697:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788592686.326115:0:11157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788592686.339116:0:11157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788592686.339395:0:11157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339418:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a6a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339426:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a78 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339432:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510a86 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339441:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339448:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339479:0:11157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339543:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339568:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 12 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.339586:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308288:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592686.339740:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339750:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.339760:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308416:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592686.339792:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339800:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 18 pid: 5817 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.339809:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308544:0@lo:104: 00000100:00100000:3.0:1788592686.339857:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592686.339891:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339911:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 18 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.339919:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308672:0@lo:104: 00000100:00100000:3.0:1788592686.339942:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592686.339967:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.339975:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 18 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.339983:0:11157:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308800:0@lo:104: 00000100:00100000:3.0:1788592686.340007:0:11157:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592686.340019:0:11157:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592686.340102:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308544 00000100:00100000:1.0:1788592686.340117:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308544 00000100:00100000:1.0:1788592686.340182:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308672 00000100:00100000:1.0:1788592686.340184:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308672 00000100:00100000:1.0:1788592686.340195:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308800 00000100:00100000:1.0:1788592686.340197:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308800 00000100:00100000:1.0:1788592686.340213:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592686.340223:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:11157:x1875475147308544:12345-0@lo:104: 00010000:00010000:1.0:1788592686.340245:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592686.340391:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592686.340401:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:11157:x1875475147308544:12345-0@lo:104: Request processed in 177us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592686.340410:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592686.340448:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592686.340458:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:11157:x1875475147308672:12345-0@lo:104: 00010000:00010000:1.0:1788592686.340468:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592686.340469:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308544:0@lo:104: 00010000:00010000:1.0:1788592686.340529:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788592686.340535:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:11157:x1875475147308672:12345-0@lo:104: Request processed in 81us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592686.340543:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788592686.340561:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788592686.340571:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:11157:x1875475147308800:12345-0@lo:104: 00000100:00100000:3.0:1788592686.340579:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308672:0@lo:104: 00010000:00010000:1.0:1788592686.340582:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592686.340624:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788592686.340630:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:11157:x1875475147308800:12345-0@lo:104: Request processed in 63us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592686.340636:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788592686.340749:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308800:0@lo:104: 00010000:00010000:2.0:1788592686.340905:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788592686.340916:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.340925:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592686.340942:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.340954:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592686.340962:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592686.340969:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592686.341118:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341127:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592686.341162:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341171:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bcccb400/0x27b316f132510a86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a8d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341189:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592686.341193:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341200:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccae00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592686.341204:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341212:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592686.341230:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592686.341235:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592686.341252:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341258:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592686.341264:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341270:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bcccae00/0x27b316f132510a78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a7f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341287:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592686.341291:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341297:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592686.341300:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341306:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592686.341313:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592686.341318:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788592686.341338:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341345:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592686.341382:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341389:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132510a6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510a71 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341409:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592686.341412:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592686.341415:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592686.341426:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592686.341447:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147309184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592686.341491:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147308928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788592686.341508:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592686.341600:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309184 00000100:00100000:2.0:1788592686.341607:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309184 00010000:00010000:2.0:1788592686.341646:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 19 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592686.341676:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592686.341680:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788592686.341725:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592686.341734:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147309056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592686.341766:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592686.341778:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147309184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592686.341800:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592686.341806:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 19 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341819:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 19 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592686.341826:0:5810:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788592686.341839:0:5810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788592686.341840:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f5e00/0x27b316f132510a71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510a6a expref: 19 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.341869:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592686.341913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3285:x1875475147309184:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592686.341920:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788592686.341965:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147308928 00000100:00100000:2.0:1788592686.341969:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147308928 00010000:00010000:2.0:1788592686.342308:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 18 pid: 5817 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592686.342324:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309056 00000100:00100000:2.0:1788592686.342327:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309056 00010000:00010000:2.0:1788592686.342341:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 19 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592686.342386:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592686.342393:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147308928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592686.342401:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592686.342405:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 19 pid: 5817 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342413:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 19 pid: 5817 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342424:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccb600/0x27b316f132510a8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510a86 expref: 19 pid: 5817 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342436:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592686.342474:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3283:x1875475147308928:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592686.342491:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788592686.342506:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592686.342512:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3283:x1875475147309056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592686.342520:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592686.342526:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 17 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342534:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 17 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342544:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccba00/0x27b316f132510a7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510a78 expref: 17 pid: 5815 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.342553:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592686.342591:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3283:x1875475147309056:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592686.342597:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592686.342640:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147309184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592686.344151:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197777480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147309056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592686.344615:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308288:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592686.344631:0:11157:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875475147308416:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592686.344667:0:11157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592686.347005:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592686.347159:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592686.349436:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789120 00000100:00100000:3.0:1788592686.349437:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789248 00000100:00100000:2.0:1788592686.349458:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789120 00000100:00100000:3.0:1788592686.349459:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789248 00010000:00010000:3.0:1788592686.349676:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 14 pid: 5815 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.349893:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 14 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592686.349953:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1788592686.349968:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+14:2344:x1875475136789120:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592686.349987:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592686.349993:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 14 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.350025:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 14 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.350045:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bccca000/0x27b316f132510aa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1939 expref: 14 pid: 5818 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592686.350065:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592686.350150:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136789120:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 186us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592686.350158:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1788592686.350267:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1788592686.350280:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2344:x1875475136789248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592686.350297:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592686.350304:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350319:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350385:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccbc00/0x27b316f132510a94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1901 expref: 12 pid: 5815 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350407:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350418:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350440:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350447:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350454:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350460:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350475:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592686.350480:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350489:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350516:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.350538:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592686.350696:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:2344:x1875475136789248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 419us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592686.350704:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1788592686.351574:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197774e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147308928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592686.353445:0:11157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.353463:0:11157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592686.353471:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5c00/0x27b316f132510ac5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592687.358700:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592687.782248:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592687.782384:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789376 00000100:00100000:3.0:1788592687.782396:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789376 00000100:00100000:3.0:1788592687.782452:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:3.0:1788592687.782462:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+11:5585:x1875475136789376:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592687.782480:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592687.782521:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1963 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592687.782567:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592687.782581:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592687.782592:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5c00, rc 0) 00000100:00100000:3.0:1788592687.782974:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789376:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 511us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592687.782982:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1788592687.802256:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592687.802366:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789504 00000100:00100000:3.0:1788592687.802379:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789504 00000100:00100000:3.0:1788592687.802449:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:3.0:1788592687.802461:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789504:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592687.802957:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789504:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 496us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592687.802967:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:1.0:1788592687.810630:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592687.810761:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789632 00000100:00100000:3.0:1788592687.810773:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789632 00000100:00100000:3.0:1788592687.810835:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:3.0:1788592687.810845:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789632:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592687.811121:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789632:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 276us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592687.811130:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:3.0:1788592687.819755:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592687.819846:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789760 00000100:00100000:2.0:1788592687.819860:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789760 00000100:00100000:2.0:1788592687.819926:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:2.0:1788592687.819939:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136789760:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592687.819959:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592687.819980:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d196a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592687.820012:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592687.820025:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592687.820034:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4000, rc 0) 00000100:00100000:2.0:1788592687.820107:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136789760:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 171us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592687.820128:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:2.0:1788592687.824801:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592687.824881:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136789888 00000100:00100000:0.0:1788592687.824894:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136789888 00000100:00100000:0.0:1788592687.824956:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:0.0:1788592687.824968:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136789888:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592687.825377:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136789888:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 382us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.825398:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:0.0:1788592687.845644:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592687.845825:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790016 00000100:00100000:3.0:1788592687.845843:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790016 00000100:00100000:3.0:1788592687.846040:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:3.0:1788592687.846059:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136790016:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592687.847040:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136790016:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 985us (1408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592687.847050:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:0.0:1788592687.887095:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147309312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592687.887175:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887231:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147309824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887273:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887313:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592687.887319:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147309696:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887342:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887379:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147310208:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887403:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887430:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147309440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592687.887449:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887463:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147309952:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887480:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887513:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592687.887519:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147309568:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887551:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887574:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147310080:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.887599:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592687.887757:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309312 00000100:00100000:0.0:1788592687.887767:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309312 00000100:00100000:0.0:1788592687.887824:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309440 00000100:00100000:0.0:1788592687.887828:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309440 00000100:00100000:0.0:1788592687.887847:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788592687.887865:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147309312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592687.887910:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592687.887967:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147309312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.887976:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788592687.887995:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592687.888002:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147309440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592687.888024:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592687.888056:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147309440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.888061:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592687.888080:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309824 00000100:00100000:0.0:1788592687.888084:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309824 00000100:00100000:0.0:1788592687.888112:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309696 00000100:00100000:0.0:1788592687.888115:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309696 00000100:00100000:0.0:1788592687.888124:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310080 00000100:00100000:0.0:1788592687.888126:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310080 00000100:00100000:0.0:1788592687.888138:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592687.888144:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147309824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.888175:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147309824:12345-0@lo:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.888181:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788592687.888193:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788592687.888198:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.888238:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147309696:12345-0@lo:400:kworker.0 Request processed in 39us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.888244:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788592687.888273:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147309696:0@lo:400:kworker.0 00010000:00080000:3.0:1788592687.888289:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf485f80 x1875475147309312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592687.888305:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147309312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592687.888316:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147309824:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.890956:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788592687.890974:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147310080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.891058:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147310080:12345-0@lo:400:kworker.0 Request processed in 92us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.891065:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788592687.891097:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310208 00000100:00100000:0.0:1788592687.891105:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310208 00000100:00100000:0.0:1788592687.891147:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309952 00000100:00100000:0.0:1788592687.891150:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309952 00000100:00100000:0.0:1788592687.891176:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788592687.891183:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147310208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.891225:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147310208:12345-0@lo:400:kworker.0 Request processed in 43us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.891232:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788592687.891244:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592687.893129:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.893226:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147309952:12345-0@lo:400:kworker.0 Request processed in 1973us (5741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.893235:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788592687.893310:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147309568 00000100:00100000:0.0:1788592687.893317:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147309568 00000100:00100000:0.0:1788592687.893373:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788592687.893383:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3283:x1875475147309568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.893418:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3283:x1875475147309568:12345-0@lo:400:kworker.0 Request processed in 38us (5866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592687.893425:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:0.0:1788592687.893461:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592687.893474:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592687.893477:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788592687.893544:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bca53b80 x1875475147310208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592687.893575:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147310208:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.893616:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147309568:0@lo:400:kworker.0 00000100:00100000:0.0:1788592687.893632:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147310080:0@lo:400:kworker.0 00010000:00080000:0.0:1788592687.893644:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf484380 x1875475147309440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592687.893673:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147309440:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788592687.896005:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bca50700 x1875475147309952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592687.896022:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147309952:0@lo:400:kworker.0 10000000:01000000:3.0:1788592688.318658:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788592688.318667:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819840e800 from 7 10000000:01000000:3.0:1788592688.318680:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592688.318742:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592688.318755:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592688.318768:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592688.318798:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592688.318897:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592688.318973:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592688.319100:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310336 00000100:00100000:2.0:1788592688.319111:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310336 00000100:00100000:2.0:1788592688.319174:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788592688.319185:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147310336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592688.319202:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592688.319229:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510ada expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.319258:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510ada expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.319269:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510ada expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.319280:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:2.0:1788592688.319336:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.319343:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788592688.319457:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592688.319473:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.319484:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592688.319546:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.319589:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.319623:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc0399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592688.320069:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310464 00000100:00100000:2.0:1788592688.320075:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310464 00000100:00100000:2.0:1788592688.320114:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788592688.320122:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592688.320445:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.320454:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788592688.320607:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.320657:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.320708:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.320741:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc0399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592688.321086:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310592 00000100:00100000:3.0:1788592688.321092:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310592 00000100:00100000:3.0:1788592688.321133:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788592688.321140:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592688.321326:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592688.321333:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788592688.325851:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788592688.328091:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788592688.328373:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788592688.328397:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592688.328410:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.328422:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592688.328433:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592688.328436:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898188438800 from 7 10000000:01000000:2.0:1788592688.328439:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592688.328485:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.328493:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.328505:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592688.328534:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592688.328614:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592688.328680:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf483900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592688.328730:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310720 00000100:00100000:3.0:1788592688.328739:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310720 00000100:00100000:3.0:1788592688.328795:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788592688.328806:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147310720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592688.328820:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592688.328837:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510ae8 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592688.328864:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510ae8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592688.328875:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510ae8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592688.328886:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4a00, rc 0) 00000100:00100000:3.0:1788592688.328944:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147310720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592688.328952:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788592688.332147:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592688.332190:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.332204:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592688.332301:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.332391:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.332443:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592688.341412:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310848 00000100:00100000:0.0:1788592688.341430:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310848 00000100:00100000:0.0:1788592688.341510:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788592688.341522:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147310848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592688.347182:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147310848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5653us (14780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592688.347198:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788592688.359591:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.359674:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.359768:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.359815:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592688.360827:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147310976 00000100:00100000:2.0:1788592688.360838:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147310976 00000100:00100000:2.0:1788592688.360896:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788592688.360908:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147310976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592688.361154:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147310976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592688.361162:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788592688.362845:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147310976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788592688.368426:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788592688.376122:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788592688.376156:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592688.376170:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.376183:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592688.376440:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592688.376444:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898190067800 from 7 10000000:01000000:0.0:1788592688.376448:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592688.376508:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592688.376517:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592688.376531:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592688.376560:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592688.376634:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592688.376697:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592688.376810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311104 00000100:00100000:1.0:1788592688.376818:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311104 00000100:00100000:1.0:1788592688.376890:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788592688.376902:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147311104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592688.376918:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592688.376932:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510af6 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.376968:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510af6 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.376980:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510af6 expref: 19 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.376990:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813dec00, rc 0) 00000100:00100000:1.0:1788592688.377042:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147311104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592688.377049:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788592688.377104:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592688.377119:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.377129:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592688.377182:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.377209:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.377230:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311232 00000100:00100000:1.0:1788592688.377234:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311232 00000100:00100000:1.0:1788592688.377267:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788592688.377274:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147311232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.377565:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147311232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592688.377573:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788592688.377606:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592688.377619:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.377659:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.377706:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592688.377725:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311360 00000100:00100000:1.0:1788592688.377729:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311360 00000100:00100000:1.0:1788592688.377750:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788592688.377756:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147311360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592688.377904:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147311360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592688.377912:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788592688.377940:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788592688.377952:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147311360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788592688.378620:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788592688.378698:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788592688.378714:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592688.378723:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592688.378734:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592688.392829:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592689.125990:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592689.126058:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790272 00000100:00100000:0.0:1788592689.126070:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790272 00000100:00100000:0.0:1788592689.126156:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:0.0:1788592689.126167:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136790272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592689.126245:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136790272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592689.126266:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00080000:1.0:1788592689.126500:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592689.127768:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592689.127829:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592689.127917:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790400 00000100:00100000:0.0:1788592689.127927:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790400 00000100:00100000:0.0:1788592689.127990:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:0.0:1788592689.127999:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136790400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1788592689.128027:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592689.128065:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136790400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592689.128072:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:1.0:1788592689.130175:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790144 00000100:00100000:1.0:1788592689.130189:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790144 00000100:00100000:1.0:1788592689.130267:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 247 00000100:00100000:1.0:1788592689.130278:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136790144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592689.130389:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136790144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 112us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592689.130397:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 247 00010000:00010000:3.0:1788592689.422050:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592690.432289:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592691.454537:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592692.461336:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788592692.482718:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592692.990752:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147311488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592692.990855:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592692.991079:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311488 00000100:00100000:2.0:1788592692.991089:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311488 00000100:00100000:2.0:1788592692.991173:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788592692.991185:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147311488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592692.991229:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592692.991281:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147311488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.991288:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788592692.993025:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592692.993054:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147311616:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993120:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993171:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147312128:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993212:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993246:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592692.993253:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147311744:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993288:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993307:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147312256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592692.993342:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993395:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312128 00000100:00100000:0.0:1788592692.993404:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312128 00000100:00100000:0.0:1788592692.993458:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311744 00000100:00100000:0.0:1788592692.993462:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311744 00000100:00100000:0.0:1788592692.993483:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788592692.993493:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147312128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993546:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147312128:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.993565:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788592692.993580:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147311872:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993583:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788592692.993589:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147311744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592692.993611:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993614:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147311744:12345-0@lo:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.993620:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788592692.993625:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592692.993629:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311872 00000100:00100000:3.0:1788592692.993630:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147312000:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.993646:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311872 00000100:00100000:3.0:1788592692.993656:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592692.993666:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788592692.993671:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592692.993681:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312256 00000100:00100000:3.0:1788592692.993684:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312256 00000100:00100000:0.0:1788592692.993703:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147311872:12345-0@lo:400:kworker.0 Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.993709:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788592692.993710:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592692.993716:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147312256:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592692.993732:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312000 00000100:00100000:0.0:1788592692.993736:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312000 00002000:00000024:3.0:1788592692.993761:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592692.993792:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147312256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592692.993798:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788592692.993840:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898197776d80 x1875475147311488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592692.993862:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147311488:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788592692.993907:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592692.993912:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592692.993992:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147311872:0@lo:400:kworker.0 00000100:00100000:1.0:1788592692.994033:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147311744:0@lo:400:kworker.0 00010000:00080000:1.0:1788592692.994044:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898197776680 x1875475147312256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592692.994056:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197776680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147312256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592692.994067:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147312128:0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.994536:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788592692.994547:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb47e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147312000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592692.994603:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb47e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147312000:12345-0@lo:400:kworker.0 Request processed in 59us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592692.994609:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592692.994986:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147311616 00000100:00100000:2.0:1788592692.994994:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147311616 00000100:00100000:2.0:1788592692.995033:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788592692.995041:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147311616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592692.995083:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147311616:12345-0@lo:400:kworker.0 Request processed in 43us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592692.995089:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00010000:00080000:1.0:1788592692.996202:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15ca80 x1875475147312000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592692.996219:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147312000:0@lo:400:kworker.0 00000100:00100000:1.0:1788592692.996258:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147311616:0@lo:400:kworker.0 00010000:00010000:3.0:1788592693.502572:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592694.245061:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592694.245131:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592694.245189:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592694.245429:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790784 00000100:00100000:1.0:1788592694.245443:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790784 00000100:00100000:1.0:1788592694.245523:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790656 00000100:00100000:1.0:1788592694.245526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790656 00000100:00100000:1.0:1788592694.245569:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1788592694.245580:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136790784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592694.245692:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136790784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 113us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.245701:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1788592694.245739:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:1.0:1788592694.245746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136790656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592694.245775:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136790656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592694.245781:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00080000:3.0:1788592694.246074:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592694.246906:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790528 00000100:00100000:0.0:1788592694.246918:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790528 00000100:00100000:0.0:1788592694.246980:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 249 00000100:00100000:0.0:1788592694.246991:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136790528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592694.247060:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136790528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 71us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592694.247068:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 249 00010000:00010000:2.0:1788592694.530721:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592695.553083:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592696.578692:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592696.642429:0:11458:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:18:13 (1788592693) === 00000100:00100000:3.0:1788592696.874203:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592696.874257:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592696.874345:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136790912 00000100:00100000:1.0:1788592696.874383:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136790912 00000100:00100000:1.0:1788592696.874455:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1788592696.874467:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136790912:12345-192.168.204.20@tcp:41:mkdir.0 00000004:00000024:1.0:1788592696.874526:0:5824:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788592696.874616:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136790912:12345-192.168.204.20@tcp:41:mkdir.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.874625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00080000:3.0:1788592696.875445:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592696.876764:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791040 00000100:00100000:2.0:1788592696.876775:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791040 00000100:00100000:2.0:1788592696.876848:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592696.876858:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9687:x1875475136791040:12345-192.168.204.20@tcp:700:mkdir.0 00000100:00100000:2.0:1788592696.876940:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9687:x1875475136791040:12345-192.168.204.20@tcp:700:mkdir.0 Request processed in 84us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592696.876948:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1788592696.907879:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592696.908947:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791296 00000100:00100000:0.0:1788592696.908970:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791296 00000100:00100000:0.0:1788592696.909050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1788592696.909062:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9687:x1875475136791296:12345-192.168.204.20@tcp:36:mkdir.0 00010000:00010000:0.0:1788592696.909145:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592696.912189:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325109e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18ec expref: 6 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.912288:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:0.0:1788592696.912322:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592696.912724:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.912740:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.912750:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.915645:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.915671:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.915685:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592696.925388:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788592696.925413:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925424:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925431:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925451:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592696.925456:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925464:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925494:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d900) 00010000:00010000:0.0:1788592696.925497:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592696.925502:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592696.925509:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592696.925532:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ad5fc4a reply state 000000009d8669d2 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592696.925542:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592696.925667:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9687:x1875475136791296:12345-192.168.204.20@tcp:36:mkdir.0 Request processed in 16602us (17794us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788592696.925677:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:3.0:1788592696.933231:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933251:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933260:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933267:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccae00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592696.933273:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933282:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933303:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff898185c2db00) 00010000:00010000:3.0:1788592696.933307:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592696.933315:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.933323:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510b0b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592696.950415:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592696.954667:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791424 00000100:00100000:1.0:1788592696.954685:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791424 00000100:00100000:1.0:1788592696.954763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1788592696.954775:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9689:x1875475136791424:12345-192.168.204.20@tcp:101:chmod.0 00010000:00010000:1.0:1788592696.954801:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592696.954830:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1971 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.954902:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.954919:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.954945:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592696.954985:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592696.954989:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592696.955027:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.955055:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1971 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.955077:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1971 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.955086:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592696.955089:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592696.955094:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813df800, rc 0) 00000100:00100000:1.0:1788592696.955168:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9689:x1875475136791424:12345-192.168.204.20@tcp:101:chmod.0 Request processed in 395us (4766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592696.955175:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1788592696.960429:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592696.960586:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791680 00000100:00100000:1.0:1788592696.960599:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791680 00000100:00100000:1.0:1788592696.960659:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1788592696.960670:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9689:x1875475136791680:12345-192.168.204.20@tcp:36:chmod.0 00010000:00010000:1.0:1788592696.960734:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592696.960765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1971 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.960804:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592696.960820:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592696.960855:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.960871:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592696.960883:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592696.961217:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7db8de5 reply state 00000000e21dfbc3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592696.961227:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788592696.961234:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788592696.961319:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:9689:x1875475136791680:12345-192.168.204.20@tcp:36:chmod.0 Request processed in 650us (901us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788592696.961327:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00010000:00010000:3.0:1788592696.970064:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970083:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970091:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970096:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813de800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592696.970102:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970111:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970130:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a000) 00010000:00010000:3.0:1788592696.970133:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592696.970139:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592696.970145:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b20 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592697.001944:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592697.002078:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791808 00000100:00100000:1.0:1788592697.002090:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791808 00000100:00100000:1.0:1788592697.002165:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1788592697.002177:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9690:x1875475136791808:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:1.0:1788592697.002206:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592697.002235:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1978 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002317:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002342:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002417:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592697.002457:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592697.002462:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592697.002522:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002562:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df800/0x27b316f132510b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1978 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002589:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1978 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.002599:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a400) 00010000:00010000:1.0:1788592697.002602:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592697.002608:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981813dea00, rc 0) 00000100:00100000:3.0:1788592697.002922:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:9690:x1875475136791808:12345-192.168.204.20@tcp:101:chown.0 Request processed in 746us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592697.002932:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1788592697.006245:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592697.006439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136791936 00000100:00100000:1.0:1788592697.006452:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136791936 00000100:00100000:1.0:1788592697.006552:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1788592697.006564:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:9690:x1875475136791936:12345-192.168.204.20@tcp:101:chown.0 00010000:00010000:1.0:1788592697.006589:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592697.006614:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dfe00/0x27b316f132510b35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d197f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006719:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006737:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006751:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006767:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006774:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006780:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006904:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006912:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.006919:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592697.006955:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592697.006959:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592697.006981:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007026:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007032:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007038:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007044:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813df400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592697.007048:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007056:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007071:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a400) 00010000:00010000:1.0:1788592697.007074:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592697.007080:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007086:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813df400/0x27b316f132510b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007107:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007113:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007118:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007130:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813de800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592697.007133:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007139:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007148:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89818289a300) 00010000:00010000:1.0:1788592697.007150:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592697.007154:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007160:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813de800/0x27b316f132510b43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007200:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dfe00/0x27b316f132510b35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d197f expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007214:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d197f expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.007223:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89818289ae00) 00010000:00010000:1.0:1788592697.007225:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592697.007228:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be400, rc 0) 00000100:00100000:1.0:1788592697.007305:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:9690:x1875475136791936:12345-192.168.204.20@tcp:101:chown.0 Request processed in 744us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592697.007314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1788592697.018179:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592697.018274:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136792192 00000100:00100000:1.0:1788592697.018300:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136792192 00000100:00100000:1.0:1788592697.018503:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:1.0:1788592697.018525:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:9690:x1875475136792192:12345-192.168.204.20@tcp:36:chown.0 00010000:00010000:1.0:1788592697.018592:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592697.018627:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132510b4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d197f expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.018647:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89818289ae00) 00010000:00010000:1.0:1788592697.018661:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592697.018689:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.018705:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.018716:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592697.088868:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:0.0:1788592697.088890:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788592697.088908:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016cc326b reply state 000000007439098e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592697.088940:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788592697.089220:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788592697.089389:0:6700:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788592697.089408:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9690:x1875475136792192:12345-192.168.204.20@tcp:36:chown.0 Request processed in 70882us (71234us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788592697.089418:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00010000:00010000:2.0:1788592697.089591:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089601:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089610:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089616:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.089621:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089629:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089647:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:2.0:1788592697.089650:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788592697.089656:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.089662:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132510b51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592697.114499:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592697.114738:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136792320 00000100:00100000:0.0:1788592697.114751:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136792320 00000100:00100000:0.0:1788592697.114823:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1788592697.114836:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9691:x1875475136792320:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:0.0:1788592697.114867:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592697.114909:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1986 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592697.123200:0:5822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8228us 00010000:00010000:2.0:1788592697.166211:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166240:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166253:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166280:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166288:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166294:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166713:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166723:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166730:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592697.166756:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788592697.166760:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592697.166803:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166817:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166825:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166833:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166850:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.166855:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166864:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166877:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a400) 00010000:00010000:2.0:1788592697.166880:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592697.166886:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166892:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5600/0x27b316f132510b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166903:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166908:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166913:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166918:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.166921:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166927:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166946:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8981a1fe1800) 00010000:00010000:2.0:1788592697.166949:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592697.166952:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166958:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4a00/0x27b316f132510b66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.166996:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1986 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.167011:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1986 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.167019:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:2.0:1788592697.167021:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788592697.167023:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5c00, rc 0) 00000100:00100000:2.0:1788592697.167124:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197776300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9691:x1875475136792320:12345-192.168.204.20@tcp:101:touch.500 Request processed in 52290us (52646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592697.167135:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1788592697.177895:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.178008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136792576 00000100:00100000:3.0:1788592697.178022:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136792576 00000100:00100000:3.0:1788592697.178103:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1788592697.178116:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9691:x1875475136792576:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:3.0:1788592697.178142:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592697.178169:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d198d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.178793:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.178814:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.178830:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.184400:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.184433:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.184538:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788592697.188821:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788592697.189221:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189242:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189257:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189299:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189307:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189316:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189323:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.189328:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.189337:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.190996:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.191004:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592697.191024:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.191035:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592697.191052:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000500e80e6 reply state 00000000549dd93e transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592697.191061:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788592697.191119:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d198d expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.191136:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d198d expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.191143:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:3.0:1788592697.191145:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592697.191148:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592697.191234:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+10:9691:x1875475136792576:12345-192.168.204.20@tcp:101:touch.500 Request processed in 13119us (13350us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788592697.191244:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00010000:00010000:2.0:1788592697.194606:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194625:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194633:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194657:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.194664:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194673:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194693:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff8981898bf800) 00010000:00010000:2.0:1788592697.194697:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592697.194703:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.194710:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510b82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592697.197194:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592697.197445:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136792832 00000100:00100000:1.0:1788592697.197468:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136792832 00000100:00100000:1.0:1788592697.197559:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1788592697.197572:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:9691:x1875475136792832:12345-192.168.204.20@tcp:36:touch.500 00010000:00010000:1.0:1788592697.197641:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592697.197674:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d198d expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.197696:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:1.0:1788592697.197708:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592697.197756:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.197786:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.197797:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592697.197951:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a72fcb68 reply state 00000000cd13df8f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592697.197961:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592697.198065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:9691:x1875475136792832:12345-192.168.204.20@tcp:36:touch.500 Request processed in 495us (880us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788592697.198073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1788592697.208111:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.210761:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136792960 00000100:00100000:3.0:1788592697.210778:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136792960 00000100:00100000:3.0:1788592697.210870:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592697.210882:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+10:9691:x1875475136792960:12345-192.168.204.20@tcp:101:touch.500 00010000:00010000:3.0:1788592697.210910:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592697.210935:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1994 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.211026:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1994 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.211043:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1994 expref: 11 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.211066:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89818289ae00) 00010000:00010000:3.0:1788592697.211069:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592697.211073:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5200, rc 0) 00000100:00100000:3.0:1788592697.211154:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+11:9691:x1875475136792960:12345-192.168.204.20@tcp:101:touch.500 Request processed in 273us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592697.211161:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00010000:00010000:2.0:1788592697.212747:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.212763:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.212770:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.212776:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.212781:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.212791:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.212831:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89818289ae00) 00010000:00010000:2.0:1788592697.212834:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592697.213629:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.213641:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592697.219184:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592697.221199:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793088 00000100:00100000:0.0:1788592697.221218:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793088 00000100:00100000:0.0:1788592697.221292:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592697.221302:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875475136793088:12345-192.168.204.20@tcp:8:touch.500 00010000:00080000:0.0:1788592697.221342:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:0.0:1788592697.221421:0:6677:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f132510ba5 00002000:00100000:0.0:1788592697.221437:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 551ef727-4fdd-447b-98b8-d223b2dddab7/ffff8981bbb8e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592697.221484:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1788592697.221797:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788592697.221840:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8981bbb8d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592697.221929:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136793088:12345-192.168.204.20@tcp:8:touch.500 Request processed in 626us (2755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592697.221937:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592697.232237:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592697.234630:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793216 00000100:00100000:2.0:1788592697.234649:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793216 00000100:00100000:3.0:1788592697.234894:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1788592697.234907:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:0:x1875475136793216:12345-192.168.204.20@tcp:2:touch.500 00000100:00080000:0.0:1788592697.243161:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788592697.344824:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000001:00080000:1.0:1788592697.344915:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788592697.347005:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:0:x1875475136793216:12345-192.168.204.20@tcp:2:touch.500 Request processed in 112090us (114768us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788592697.347021:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1788592697.349715:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592697.349796:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793472 00000100:00100000:0.0:1788592697.349808:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793472 00000100:00100000:0.0:1788592697.349883:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1788592697.349895:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:9691:x1875475136793472:12345-192.168.204.20@tcp:35:touch.500 00000100:00100000:0.0:1788592697.350301:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:9691:x1875475136793472:12345-192.168.204.20@tcp:35:touch.500 Request processed in 405us (593us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788592697.350309:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1788592697.393633:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592697.393760:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793600 00000100:00100000:1.0:1788592697.393773:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793600 00000100:00100000:1.0:1788592697.393851:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1788592697.393862:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:9692:x1875475136793600:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1788592697.393890:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592697.393915:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d199b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.393992:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.394010:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.394042:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592697.394085:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592697.394089:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592697.394132:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.394173:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d199b expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.394196:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d199b expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.394205:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:1.0:1788592697.394208:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592697.394214:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf600, rc 0) 00000100:00100000:1.0:1788592697.395627:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+12:9692:x1875475136793600:12345-192.168.204.20@tcp:101:rm.0 Request processed in 1757us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592697.395640:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1788592697.413312:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.413490:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793856 00000100:00100000:3.0:1788592697.413503:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793856 00000100:00100000:3.0:1788592697.413582:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1788592697.413594:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+12:9692:x1875475136793856:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1788592697.413623:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592697.413649:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19a2 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592697.413756:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788592697.413963:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19a2 expref: 14 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.413982:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a400) 00010000:00010000:3.0:1788592697.413985:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592697.413992:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19a2 expref: 14 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.414008:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5000, rc 0) 00000100:00100000:3.0:1788592697.414098:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:9692:x1875475136793856:12345-192.168.204.20@tcp:101:rm.0 Request processed in 505us (795us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788592697.414106:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1788592697.430989:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.431114:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136793984 00000100:00100000:3.0:1788592697.431127:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136793984 00000100:00100000:3.0:1788592697.431195:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1788592697.431207:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:9692:x1875475136793984:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:3.0:1788592697.435787:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:9692:x1875475136793984:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4569us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592697.435805:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1788592697.451574:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592697.451758:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136794240 00000100:00100000:0.0:1788592697.451772:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136794240 00000100:00100000:0.0:1788592697.451849:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592697.451862:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:9692:x1875475136794240:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1788592697.452295:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:9692:x1875475136794240:12345-192.168.204.20@tcp:35:rm.0 Request processed in 435us (730us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788592697.452305:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592697.456146:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.456262:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136794496 00000100:00100000:3.0:1788592697.456275:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136794496 00000100:00100000:3.0:1788592697.456392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1788592697.456404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:9692:x1875475136794496:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1788592697.456436:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592697.456463:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19a9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.456615:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510bcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.456634:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.456648:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510bcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592697.456661:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788592697.456821:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19a9 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.456844:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510bcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19a9 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.456855:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.456858:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592697.456863:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592697.456939:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136794496:12345-192.168.204.20@tcp:101:rm.0 Request processed in 537us (805us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788592697.456947:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1788592697.467383:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.467615:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136794624 00000100:00100000:3.0:1788592697.467628:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136794624 00000100:00100000:3.0:1788592697.467703:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:3.0:1788592697.467715:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136794624:12345-192.168.204.20@tcp:41:rm.0 00000004:00000024:3.0:1788592697.467788:0:6700:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788592697.467886:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136794624:12345-192.168.204.20@tcp:41:rm.0 Request processed in 174us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592697.467895:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:0.0:1788592697.486577:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.486724:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136794752 00000100:00100000:3.0:1788592697.486736:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136794752 00000100:00100000:3.0:1788592697.486804:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:3.0:1788592697.486815:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136794752:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1788592697.486841:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592697.486869:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19b0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.486978:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.486995:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487009:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487026:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487032:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487038:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487179:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487207:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487216:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592697.487248:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788592697.487253:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592697.487272:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487285:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487294:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487301:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487308:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487314:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.487319:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487328:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487341:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.487344:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592697.487403:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487410:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510be4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487425:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487430:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487436:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487441:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.487443:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487460:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487480:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff8981898bfd00) 00010000:00010000:3.0:1788592697.487483:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592697.487486:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487491:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510beb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487523:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510bdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b0 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487549:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b0 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.487557:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89818289ae00) 00010000:00010000:3.0:1788592697.487559:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592697.487562:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4600, rc 0) 00000100:00100000:3.0:1788592697.487632:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+17:9692:x1875475136794752:12345-192.168.204.20@tcp:101:rm.0 Request processed in 819us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592697.487640:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1788592697.495090:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.495226:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795008 00000100:00100000:3.0:1788592697.495239:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795008 00000100:00100000:3.0:1788592697.495314:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1788592697.495335:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+17:9692:x1875475136795008:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1788592697.495425:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788592697.495478:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510bf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b0 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495508:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1994 expref: 16 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495523:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89818289ae00) 00010000:00010000:3.0:1788592697.495543:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d199b expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495553:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.495577:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592697.495610:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495626:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495637:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495654:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495661:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495669:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495802:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495816:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.495824:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592697.496736:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788592697.496753:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 271737401970ns, next at 272737399115ns, rc = 0 00010000:00010000:3.0:1788592697.496831:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496856:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496866:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496876:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496882:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496889:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496906:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592697.496929:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496936:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496942:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496947:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.496952:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496960:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496981:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8981898bf400) 00010000:00010000:3.0:1788592697.496984:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788592697.496990:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.496997:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f800/0x27b316f132510c07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497017:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497022:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497028:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497033:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.497035:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497041:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497048:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.497051:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592697.497054:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.497060:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510bf9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592697.497082:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b436b73 reply state 00000000585679bf transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592697.497091:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788592697.497633:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592697.497642:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.497650:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592697.497654:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.497670:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.497681:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8981898bf400) 00010000:00010000:1.0:1788592697.497684:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788592697.497688:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.497694:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510c0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.497715:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592697.497717:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592697.497719:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592697.497831:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136795008:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2502us (2757us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788592697.497842:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00010000:00010000:3.0:1788592697.502055:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502087:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502096:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502102:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592697.502107:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502125:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502144:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc446f69f (ffff8981898bf100) 00010000:00010000:3.0:1788592697.502148:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592697.502155:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.502162:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc446f69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592697.506765:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.507790:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795264 00000100:00100000:3.0:1788592697.507805:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795264 00000100:00100000:3.0:1788592697.507870:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1788592697.507882:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+15:9692:x1875475136795264:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:3.0:1788592697.508188:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136795264:12345-192.168.204.20@tcp:35:rm.0 Request processed in 306us (1431us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788592697.508205:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1788592697.522566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592697.522802:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795520 00000100:00100000:3.0:1788592697.522815:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795520 00000100:00100000:3.0:1788592697.522889:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1788592697.522901:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+16:9692:x1875475136795520:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1788592697.522983:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788592697.523018:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510bcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19a9 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.523045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1986 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.523059:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:3.0:1788592697.523093:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981813dea00/0x27b316f132510b2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1978 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.523106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a400) 00010000:00010000:3.0:1788592697.523602:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592697.523908:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.523928:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.523942:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.523956:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.523963:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.523970:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.524834:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.524848:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.524858:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592697.530079:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788592697.530106:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.531932:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.531946:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.531951:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592697.531957:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.531967:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.531988:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89818289ac00) 00010000:00010000:1.0:1788592697.531991:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788592697.531997:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532025:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132510c23 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532168:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532175:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532181:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532186:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592697.532257:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532265:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532273:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a100) 00010000:00010000:1.0:1788592697.532276:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592697.532279:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592697.532285:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510c15 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592697.532301:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e0fcb9a reply state 000000001333342f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592697.532311:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592697.533008:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:9692:x1875475136795520:12345-192.168.204.20@tcp:36:rm.0 Request processed in 10103us (10446us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788592697.533020:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00010000:00010000:2.0:1788592697.541809:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541832:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541840:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541847:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592697.541853:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541862:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541905:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89818289ad00) 00010000:00010000:2.0:1788592697.541908:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592697.541915:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592697.541923:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510c1c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592697.600547:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592698.110757:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147312512:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.110846:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.110916:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147313024:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.110942:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.110988:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592698.110994:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147312384:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.111028:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.111048:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147312896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.111205:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.111236:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147312768:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.111262:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.111280:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592698.111286:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147312640:0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.111328:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592698.111386:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313024 00000100:00100000:0.0:1788592698.111397:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313024 00000100:00100000:2.0:1788592698.112729:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312768 00000100:00100000:2.0:1788592698.112738:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312768 00000100:00100000:2.0:1788592698.112794:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592698.112806:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147313024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592698.112898:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147313024:12345-0@lo:400:kworker.0 Request processed in 94us (1954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592698.112905:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592698.112928:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788592698.113132:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147312768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592698.113169:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147312768:12345-0@lo:400:kworker.0 Request processed in 235us (1906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592698.113175:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788592698.113221:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf485f80 x1875475147312768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592698.113236:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147312768:0@lo:400:kworker.0 00000100:00100000:2.0:1788592698.113253:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592698.113267:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147313152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592698.113300:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592698.113390:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313152 00000100:00100000:2.0:1788592698.113394:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313152 00000100:00100000:2.0:1788592698.113421:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592698.113428:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147313152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592698.113471:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592698.114180:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312384 00000100:00100000:1.0:1788592698.114188:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312384 00000100:00100000:1.0:1788592698.114230:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788592698.114239:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147312384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592698.114290:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147312384:12345-0@lo:400:kworker.0 Request processed in 52us (3261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592698.114297:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:0.0:1788592698.114514:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592698.114520:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592698.114537:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312512 00000100:00100000:0.0:1788592698.114542:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312512 00000100:00100000:0.0:1788592698.114575:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312896 00000100:00100000:0.0:1788592698.114578:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312896 00000100:00100000:0.0:1788592698.114600:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147312640 00000100:00100000:0.0:1788592698.114603:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147312640 00000100:00100000:0.0:1788592698.114619:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788592698.114626:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147312512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.114666:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147312512:12345-0@lo:400:kworker.0 Request processed in 41us (3821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592698.114673:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788592698.114687:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788592698.114692:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147312896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592698.114720:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147312896:12345-0@lo:400:kworker.0 Request processed in 28us (3516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592698.114726:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788592698.114737:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788592698.114743:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147312640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592698.126453:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147312384:0@lo:400:kworker.0 00000100:00100000:3.0:1788592698.126493:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147312896:0@lo:400:kworker.0 00000100:00100000:3.0:1788592698.126507:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147312512:0@lo:400:kworker.0 00010000:00080000:3.0:1788592698.126525:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf487b80 x1875475147313024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592698.126536:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf487b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147313024:0@lo:400:kworker.0 00000100:00100000:3.0:1788592698.126602:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147313280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592698.126683:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592698.126808:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788592698.126820:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788592698.127451:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147312640:12345-0@lo:400:kworker.0 Request processed in 12704us (16117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592698.127474:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788592698.127611:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592698.128110:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147313152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14678us (14805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592698.128131:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788592698.128156:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313280 00000100:00100000:2.0:1788592698.128166:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313280 00000100:00100000:2.0:1788592698.128207:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788592698.128215:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147313280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592698.128244:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592698.128305:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147313280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592698.128311:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788592698.130255:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898197774380 x1875475147313152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592698.130288:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898197774380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147313152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592698.130309:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147312640:0@lo:400:kworker.0 00010000:00080000:3.0:1788592698.130371:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb24a680 x1875475147313280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592698.130383:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147313280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788592698.625956:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592699.368758:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592699.368815:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592699.368855:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592699.368878:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592699.368966:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795904 00000100:00100000:1.0:1788592699.368979:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795904 00000100:00100000:1.0:1788592699.369063:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1788592699.369075:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136795904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592699.369163:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136795904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592699.369170:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1788592699.369207:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795776 00000100:00100000:1.0:1788592699.369211:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795776 00000100:00100000:1.0:1788592699.369245:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796032 00000100:00100000:1.0:1788592699.369247:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796032 00000100:00100000:1.0:1788592699.369274:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:1.0:1788592699.369280:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+14:2344:x1875475136795776:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592699.369316:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+14:2344:x1875475136795776:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592699.369335:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:1.0:1788592699.369379:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:1.0:1788592699.369388:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136796032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592699.369414:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136796032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592699.369421:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00080000:0.0:1788592699.369570:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592699.369578:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592699.369689:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136795648 00000100:00100000:3.0:1788592699.369705:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136795648 00000100:00100000:3.0:1788592699.369775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 251 00000100:00100000:3.0:1788592699.369786:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136795648:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592699.369867:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136795648:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 82us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592699.370556:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 251 00010000:00010000:3.0:1788592699.646730:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592700.671977:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592701.694515:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788592702.327226:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1788592702.327251:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788592702.327313:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788592702.327824:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147313408:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788592702.327915:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592702.328134:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313408 00000100:00100000:0.0:1788592702.328143:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313408 00000100:00100000:0.0:1788592702.328221:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592702.328233:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147313408:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788592702.328259:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788592702.328300:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9bc238, atime: 0x6a9bc238, ctime: 0x6a9bc238, blocks: 0x1 00010000:00010000:0.0:1788592702.328310:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592702.328328:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=276s v=(0 0) 00010000:00010000:0.0:1788592702.328334:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592702.328342:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592702.328401:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592702.328411:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592702.328420:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592702.328458:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592702.329434:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592702.329443:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592702.329454:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592702.329458:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592702.329468:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592702.329488:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592702.329506:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510c2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592702.329528:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592702.329529:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592702.329531:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592702.329670:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592702.329786:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147313408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1554us (1869us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788592702.329795:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788592702.330455:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bb248a80/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788592702.330464:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147313408:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788592702.724671:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788592702.940801:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1788592703.232560:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147313664:0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.232629:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147314048:0@lo:400:kworker.0 00000100:00100000:3.0:1788592703.232641:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592703.235496:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592703.235517:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147313792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.235592:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592703.235602:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147314176:0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.235647:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592703.235684:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313664 00000100:00100000:1.0:1788592703.235694:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313664 00000100:00100000:0.0:1788592703.235725:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592703.235799:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147314304:0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.235812:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788592703.235824:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147313664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592703.235864:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592703.236249:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147313920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.241863:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147313664:12345-0@lo:400:kworker.0 Request processed in 6030us (9211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592703.241882:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788592703.241895:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314048 00000100:00100000:0.0:1788592703.241911:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314048 00000100:00100000:1.0:1788592703.241986:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314304 00000100:00100000:0.0:1788592703.241994:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788592703.241995:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314304 00000100:00100000:0.0:1788592703.242015:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147314048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.242064:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592703.242075:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147314304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.242131:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147314304:12345-0@lo:400:kworker.0 Request processed in 59us (6269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592703.242149:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592703.242171:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314176 00000100:00100000:1.0:1788592703.242175:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314176 00000100:00100000:1.0:1788592703.242199:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313792 00000100:00100000:1.0:1788592703.242201:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313792 00000100:00100000:1.0:1788592703.242227:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788592703.242233:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147314176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.242376:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147314176:12345-0@lo:400:kworker.0 Request processed in 114us (6699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592703.242383:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788592703.242396:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788592703.242649:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147313792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592703.242680:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147313792:12345-0@lo:400:kworker.0 Request processed in 34us (6963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592703.242685:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788592703.242707:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592703.242711:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592703.242742:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147314176:0@lo:400:kworker.0 00000100:00100000:3.0:1788592703.246504:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592703.246563:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147314432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592703.246593:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592703.246617:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314432 00000100:00100000:3.0:1788592703.246623:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314432 00000100:00100000:3.0:1788592703.246676:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592703.246684:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875475147314432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592703.246728:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592703.246771:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3284:x1875475147314432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592703.246778:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592703.246806:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313920 00000100:00100000:3.0:1788592703.246809:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313920 00000100:00100000:3.0:1788592703.246857:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788592703.246862:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147313920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592703.246952:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147314048:12345-0@lo:400:kworker.0 Request processed in 4932us (11451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592703.246966:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788592703.247018:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147313920:12345-0@lo:400:kworker.0 Request processed in 153us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592703.247033:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1788592703.247066:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592703.247105:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788592703.247111:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bb248a80, transno 4294967300 00000100:00100000:3.0:1788592703.247324:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147314432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592703.247745:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147313920:0@lo:400:kworker.0 00000100:00100000:3.0:1788592703.247784:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147313664:0@lo:400:kworker.0 00000100:00100000:3.0:1788592703.247803:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147313536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592703.247844:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592703.247943:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147313536 00000100:00100000:1.0:1788592703.247951:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147313536 00000100:00100000:1.0:1788592703.247990:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788592703.247998:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147313536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592703.248025:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592703.248073:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147313536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592703.248080:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788592703.248236:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bf486a00 x1875475147313536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592703.248310:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147313536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592703.249676:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147314048:0@lo:400:kworker.0 00000100:00100000:0.0:1788592703.249749:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147313792:0@lo:400:kworker.0 00010000:00080000:0.0:1788592703.250341:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981886f2300 x1875475147314304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592703.250421:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147314304:0@lo:400:kworker.0 00000001:02000400:0.0:1788592703.558535:0:11610:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788592703.743607:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592704.489089:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592704.489195:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592704.489305:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592704.489433:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592704.489597:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796288 00000100:00100000:3.0:1788592704.489610:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796288 00000100:00100000:3.0:1788592704.489685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796544 00000100:00100000:3.0:1788592704.489689:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796544 00000100:00100000:3.0:1788592704.489729:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:3.0:1788592704.489747:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2343:x1875475136796288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592704.489852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2343:x1875475136796288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 114us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.489861:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:3.0:1788592704.489879:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:3.0:1788592704.489886:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136796544:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592704.489909:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136796544:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.489916:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:3.0:1788592704.489948:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796160 00000100:00100000:3.0:1788592704.489951:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796160 00000100:00100000:3.0:1788592704.489974:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00100000:3.0:1788592704.489980:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2343:x1875475136796160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592704.490021:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2343:x1875475136796160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 40us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.490029:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 253 00000100:00080000:3.0:1788592704.490068:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592704.490127:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796416 00000100:00100000:2.0:1788592704.490134:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796416 00000100:00100000:2.0:1788592704.490196:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1788592704.490212:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2343:x1875475136796416:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:3.0:1788592704.490236:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592704.490256:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2343:x1875475136796416:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 46us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592704.490262:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000020:00000080:0.0:1788592704.573500:0:11658:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc8f478570 20000000:00000080:0.0:1788592704.573529:0:11658:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8981bc182c00 uarg=0000000000000000 20000000:01000000:0.0:1788592704.573572:0:11658:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788592704.573580:0:11658:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788592704.573585:0:11658:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788592704.574514:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788592704.574692:0:11658:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788592704.581150:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788592704.581205:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788592704.581264:0:11658:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788592704.581282:0:11658:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788592704.581308:0:11658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581332:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581376:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581384:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510ada expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581391:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510ae8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581398:0:11658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510af6 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581406:0:11658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581454:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581483:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 18 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.581498:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314560:0@lo:104: 00000100:00100000:0.0:1788592704.581575:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592704.581639:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581646:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 18 pid: 5815 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.581653:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314688:0@lo:104: 00000100:00100000:0.0:1788592704.581670:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592704.581696:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132510ada expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581702:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132510ada expref: 18 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.581709:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314816:0@lo:104: 00000100:00100000:0.0:1788592704.581728:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592704.581742:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581751:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 12 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.581758:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314944:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592704.581819:0:11658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.581827:0:11658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.581834:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147315072:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592704.581851:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819888e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788592704.582044:0:5806:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788592704.582060:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314560 00000100:00100000:3.0:1788592704.582067:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314560 00000100:00100000:3.0:1788592704.582109:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314688 00000100:00100000:3.0:1788592704.582111:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314688 00000100:00100000:3.0:1788592704.582118:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147314816 00000100:00100000:3.0:1788592704.582119:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147314816 00000100:00100000:3.0:1788592704.582130:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592704.582138:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:11658:x1875475147314560:12345-0@lo:104: 00010000:00010000:3.0:1788592704.582153:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582216:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592704.582222:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+5:11658:x1875475147314560:12345-0@lo:104: Request processed in 85us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.582228:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592704.582244:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592704.582249:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:11658:x1875475147314688:12345-0@lo:104: 00010000:00010000:3.0:1788592704.582255:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582280:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592704.582292:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+4:11658:x1875475147314688:12345-0@lo:104: Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.582297:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592704.582308:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788592704.582313:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89808658cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:11658:x1875475147314816:12345-0@lo:104: 00010000:00010000:3.0:1788592704.582319:0:5806:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582438:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788592704.582443:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89808658cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+3:11658:x1875475147314816:12345-0@lo:104: Request processed in 130us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.582448:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788592704.582491:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788592704.582497:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582504:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592704.582508:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582517:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592704.582524:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592704.582529:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592704.582559:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582574:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592704.582597:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582604:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bccca000/0x27b316f132510af6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510afd expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582618:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592704.582620:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582626:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592704.582628:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582634:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592704.582640:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592704.582645:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592704.582655:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582660:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592704.582665:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582670:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132510ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510aef expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582682:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592704.582685:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582689:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592704.582691:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582697:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592704.582702:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592704.582706:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592704.582714:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582718:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592704.582731:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582736:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c21c4400/0x27b316f132510ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132510ae1 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.582750:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592704.582752:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592704.582753:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592704.582759:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592704.582778:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147315200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592704.582810:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592704.582832:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592704.582836:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147315328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592704.582851:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592704.582874:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147315456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592704.582896:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592704.582932:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315200 00000100:00100000:3.0:1788592704.582936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315200 00010000:00010000:3.0:1788592704.583038:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 19 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592704.583060:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315328 00000100:00100000:3.0:1788592704.583063:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315328 00010000:00010000:3.0:1788592704.583072:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 20 pid: 5815 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592704.583079:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315456 00000100:00100000:3.0:1788592704.583081:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315456 00010000:00010000:3.0:1788592704.583089:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510ada expref: 21 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592704.583099:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592704.583105:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+21:3285:x1875475147315200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592704.583116:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592704.583121:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 21 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583133:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 21 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583160:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592704.583190:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+21:3285:x1875475147315200:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.583198:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592704.583213:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592704.583218:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+20:3285:x1875475147315328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592704.583226:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592704.583230:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 20 pid: 5815 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583239:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 20 pid: 5815 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583248:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592704.583267:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+20:3285:x1875475147315328:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.583273:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788592704.583284:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592704.583290:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147315456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592704.583297:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592704.583300:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132510ada expref: 19 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583310:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132510ada expref: 19 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.583319:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592704.583387:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147315456:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.583393:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788592704.583458:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147315456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592704.583485:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147315328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592704.583491:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147315200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592704.584909:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dec00/0x27b316f132510afd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510af6 expref: 18 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.585038:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314560:0@lo:104: 00010000:00010000:0.0:1788592704.585054:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c4a00/0x27b316f132510aef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510ae8 expref: 17 pid: 5815 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.585062:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314688:0@lo:104: 00010000:00010000:0.0:1788592704.585070:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f5000/0x27b316f132510ae1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132510ada expref: 16 pid: 5817 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592704.585077:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314816:0@lo:104: 00000100:00100000:0.0:1788592704.586758:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147314944:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592704.586772:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11658:1875475147315072:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592704.586814:0:11658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592704.590202:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592704.590584:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796672 00000100:00100000:3.0:1788592704.590597:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796672 00010000:00010000:3.0:1788592704.590650:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592704.590698:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1788592704.590708:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136796672:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592704.590726:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592704.590732:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.590746:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.590768:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4000/0x27b316f132510ad3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d196a expref: 13 pid: 5815 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.590788:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592704.590855:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2344:x1875475136796672:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 148us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.590863:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1788592704.595209:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592704.595392:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796800 00000100:00100000:3.0:1788592704.595406:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796800 00010000:00010000:3.0:1788592704.595472:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592704.595529:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1788592704.595540:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2344:x1875475136796800:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592704.595559:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592704.595564:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595578:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595601:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5c00/0x27b316f132510acc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1963 expref: 12 pid: 5817 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595623:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595631:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595648:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595655:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595663:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595690:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595697:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccac00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592704.595702:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595711:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595733:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.595745:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592704.595810:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+11:2344:x1875475136796800:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 271us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592704.595818:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00010000:00010000:0.0:1788592704.595850:0:11658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.595874:0:11658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592704.595890:0:11658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccac00/0x27b316f132510c31 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592704.766506:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592705.790581:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788592706.174534:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592706.174543:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819840e800 from 7 10000000:01000000:1.0:1788592706.174550:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592706.174611:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.174624:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.174636:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592706.174666:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.174750:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.174834:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592706.175159:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315584 00000100:00100000:2.0:1788592706.175168:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315584 00000100:00100000:2.0:1788592706.175234:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788592706.175245:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:5820:x1875475147315584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592706.175258:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592706.175274:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5600/0x27b316f132510c3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510c38 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.175300:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5600/0x27b316f132510c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510c38 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.175746:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5600/0x27b316f132510c3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510c38 expref: 17 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.175758:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5600, rc 0) 00000100:00100000:2.0:1788592706.175827:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147315584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 584us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.175835:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788592706.176283:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592706.176317:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.176328:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592706.176439:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.176677:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.176729:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592706.179405:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315712 00000100:00100000:3.0:1788592706.179432:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315712 00000100:00100000:3.0:1788592706.179524:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788592706.179534:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147315712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592706.179896:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147315712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.179916:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788592706.180338:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.180431:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.180506:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.180558:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592706.180673:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315840 00000100:00100000:2.0:1788592706.180679:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315840 00000100:00100000:2.0:1788592706.180719:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788592706.180726:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147315840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592706.180890:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147315840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.180911:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788592706.182294:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147315840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.185058:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11671:1875475147315968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592706.185345:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.185444:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592706.185561:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147315968 00000100:00100000:2.0:1788592706.185570:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147315968 00000100:00100000:2.0:1788592706.185627:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788592706.185635:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:11671:x1875475147315968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592706.185867:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:11671:x1875475147315968:12345-0@lo:502:llog_process_th.0 Request processed in 232us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.185874:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788592706.187899:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11671:1875475147315968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592706.187984:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592706.187995:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592706.187997:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592706.188005:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89819840e800 00000020:00000080:3.0:1788592706.188008:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788592706.188147:0:11671:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11671:1875475147316096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592706.188220:0:11671:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592706.188272:0:11671:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197713d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592706.190819:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316096 00000100:00100000:0.0:1788592706.190834:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316096 00000100:00100000:0.0:1788592706.190924:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788592706.190935:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:11671:x1875475147316096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592706.191280:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:11671:x1875475147316096:12345-0@lo:502:llog_process_th.0 Request processed in 346us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.191287:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788592706.191838:0:11671:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11671:1875475147316096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592706.191886:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592706.191897:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592706.191909:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788592706.191916:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788592706.192999:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788592706.193026:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592706.193048:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.193063:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592706.193076:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592706.193079:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898188438800 from 7 10000000:01000000:0.0:1788592706.193081:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592706.193123:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.193131:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.193154:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592706.193182:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.193247:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.193293:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981932e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592706.193956:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316224 00000100:00100000:1.0:1788592706.193967:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316224 00000100:00100000:1.0:1788592706.194032:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788592706.194044:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:5820:x1875475147316224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592706.194058:0:5817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592706.194073:0:5817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bfe00/0x27b316f132510c4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510c46 expref: -99 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.194215:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bfe00/0x27b316f132510c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510c46 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.194227:0:5817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bfe00/0x27b316f132510c4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510c46 expref: 18 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592706.194235:0:5817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfe00, rc 0) 00000100:00100000:1.0:1788592706.194326:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.194334:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788592706.194392:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592706.194418:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.194428:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592706.194511:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.194552:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.194585:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981932e50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592706.194631:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316352 00000100:00100000:3.0:1788592706.194637:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316352 00000100:00100000:3.0:1788592706.194680:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788592706.194692:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788592706.196175:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1478us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.196190:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788592706.198910:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.199000:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.199542:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.199646:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981932e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592706.199704:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316480 00000100:00100000:1.0:1788592706.199712:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316480 00000100:00100000:1.0:1788592706.199870:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788592706.199883:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.200380:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 471us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.200388:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788592706.200528:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.202345:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11673:1875475147316608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592706.202443:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.202491:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881dee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592706.203477:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316608 00000100:00100000:2.0:1788592706.203494:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316608 00000100:00100000:2.0:1788592706.203561:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788592706.203573:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:11673:x1875475147316608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592706.204554:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:11673:x1875475147316608:12345-0@lo:502:llog_process_th.0 Request processed in 977us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.204562:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11673:1875475147316608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592706.204574:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:01000000:1.0:1788592706.204639:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592706.204654:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592706.204658:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788592706.204666:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff898188438800 00000020:00000080:1.0:1788592706.204670:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592706.204940:0:11673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11673:1875475147316736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592706.205007:0:11673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.205063:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316736 00000100:00100000:1.0:1788592706.205070:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316736 00000100:00100000:1.0:1788592706.205123:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788592706.205139:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:11673:x1875475147316736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592706.205395:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:11673:x1875475147316736:12345-0@lo:502:llog_process_th.0 Request processed in 257us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.205402:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788592706.205453:0:11673:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592706.205466:0:11673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11673:1875475147316736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592706.205498:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592706.205503:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592706.205505:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788592706.205509:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788592706.206085:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788592706.206198:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592706.206215:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.206230:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592706.206243:0:5820:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788592706.206246:0:5820:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff898190067800 from 7 10000000:01000000:2.0:1788592706.206249:0:5820:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592706.206296:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.206327:0:5820:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.206340:0:5820:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592706.206889:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592706.206973:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592706.207027:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592706.207804:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316864 00000100:00100000:0.0:1788592706.207815:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316864 00000100:00100000:0.0:1788592706.207871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788592706.207882:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:5820:x1875475147316864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592706.207901:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592706.207921:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bccca800/0x27b316f132510c5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132510c54 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.207955:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca800/0x27b316f132510c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132510c54 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.207968:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bccca800/0x27b316f132510c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132510c54 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592706.207979:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca800, rc 0) 00000100:00100000:0.0:1788592706.208125:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147316864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 245us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.208133:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788592706.223544:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592706.223591:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.223608:0:5820:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592706.223737:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592706.225904:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592706.226007:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147316992 00000100:00100000:0.0:1788592706.226023:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147316992 00000100:00100000:0.0:1788592706.226113:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788592706.226124:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147316992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592706.226859:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592706.227751:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187359850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147316992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1623us (1851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.227765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788592706.230210:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147316992:0@lo:501:ll_cfg_requeue.0 00000040:00080000:1.0:1788592706.231659:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788592706.236219:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147317120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.236315:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.236437:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317120 00000100:00100000:1.0:1788592706.236450:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317120 00000100:00100000:0.0:1788592706.236558:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881de000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592706.236603:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788592706.236612:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147317120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.236817:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:5820:x1875475147317120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.236825:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788592706.237009:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3766d60d-7279-4c7a-a56f-5f796f49fe93:5820:1875475147317120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.237640:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11677:1875475147317248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592706.237693:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592706.237857:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317248 00000100:00100000:3.0:1788592706.237863:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317248 00000100:00100000:3.0:1788592706.237896:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788592706.237903:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:11677:x1875475147317248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592706.238070:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898187358050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:11677:x1875475147317248:12345-0@lo:502:llog_process_th.0 Request processed in 166us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.238077:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788592706.238216:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881dee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592706.238233:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bed880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11677:1875475147317248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592706.238261:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592706.238272:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592706.238274:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788592706.238282:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff898190067800 00000020:00000080:1.0:1788592706.238284:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788592706.238406:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11677:1875475147317376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592706.238443:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592706.238461:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190452f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592706.238789:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317376 00000100:00100000:3.0:1788592706.238795:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317376 00000100:00100000:3.0:1788592706.238833:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788592706.238839:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:11677:x1875475147317376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592706.238981:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:11677:x1875475147317376:12345-0@lo:502:llog_process_th.0 Request processed in 142us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.238988:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788592706.239069:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3766d60d-7279-4c7a-a56f-5f796f49fe93:11677:1875475147317376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788592706.239094:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592706.239099:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592706.239101:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788592706.239104:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788592706.239384:0:5820:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788592706.239411:0:5820:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788592706.239422:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592706.239433:0:5820:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592706.605756:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592706.606185:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136796928 00000100:00100000:3.0:1788592706.606200:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136796928 00000100:00100000:3.0:1788592706.606278:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 269 00000100:00100000:3.0:1788592706.606290:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:5585:x1875475136796928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592706.606325:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592706.606382:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762f800/0x27b316f132510c62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19b7 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592706.606425:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762f800/0x27b316f132510c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b7 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592706.606439:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762f800/0x27b316f132510c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b7 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592706.606473:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762f800, rc 0) 00000100:00100000:3.0:1788592706.606557:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136796928:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 269us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.606565:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 269 00000100:00100000:1.0:1788592706.619328:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592706.619568:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797056 00000100:00100000:0.0:1788592706.619581:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797056 00000100:00100000:0.0:1788592706.619651:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 270 00000100:00100000:0.0:1788592706.619663:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136797056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.620609:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136797056:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 942us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.620621:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 270 00000100:00100000:0.0:1788592706.633098:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592706.637077:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797184 00000100:00100000:1.0:1788592706.637101:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797184 00000100:00100000:1.0:1788592706.637389:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 271 00000100:00100000:1.0:1788592706.637415:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136797184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.637771:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136797184:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 370us (4687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.637788:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 271 00000100:00100000:2.0:1788592706.649735:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592706.654056:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797312 00000100:00100000:0.0:1788592706.654078:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797312 00000100:00100000:0.0:1788592706.654703:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 272 00000100:00100000:0.0:1788592706.654719:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:9963:x1875475136797312:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592706.655078:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:9963:x1875475136797312:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 362us (6692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.655087:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 272 00000100:00100000:2.0:1788592706.665727:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592706.666025:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797440 00000100:00100000:1.0:1788592706.666038:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797440 00000100:00100000:1.0:1788592706.670024:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:1.0:1788592706.670059:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:9963:x1875475136797440:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592706.670695:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:9963:x1875475136797440:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 651us (5010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.670705:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 273 00000100:00100000:0.0:1788592706.676092:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592706.676345:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797568 00000100:00100000:2.0:1788592706.676393:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797568 00000100:00100000:2.0:1788592706.676475:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:2.0:1788592706.676505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+12:5585:x1875475136797568:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592706.676530:0:5818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592706.676554:0:5818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f4800/0x27b316f132510c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19be expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.676595:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4800/0x27b316f132510c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19be expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.676608:0:5818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f4800/0x27b316f132510c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19be expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592706.676618:0:5818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4800, rc 0) 00000100:00100000:2.0:1788592706.676687:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136797568:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 186us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592706.676695:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 274 00000100:00100000:2.0:1788592706.687127:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592706.687283:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797696 00000100:00100000:0.0:1788592706.687309:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797696 00000100:00100000:0.0:1788592706.687959:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:0.0:1788592706.687985:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136797696:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592706.689607:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136797696:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 1616us (2479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.689644:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 275 00000100:00100000:0.0:1788592706.697740:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592706.698072:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797824 00000100:00100000:1.0:1788592706.698086:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797824 00000100:00100000:1.0:1788592706.698163:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:1.0:1788592706.698175:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136797824:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592706.698531:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:5585:x1875475136797824:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 358us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592706.698540:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 276 00000100:00100000:1.0:1788592706.702059:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592706.702414:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136797952 00000100:00100000:0.0:1788592706.702428:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136797952 00000100:00100000:0.0:1788592706.702498:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 277 00000100:00100000:0.0:1788592706.702511:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:9966:x1875475136797952:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592706.702933:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:9966:x1875475136797952:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 423us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592706.702943:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 277 00000100:00100000:2.0:1788592706.718755:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592706.719851:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798080 00000100:00100000:3.0:1788592706.719867:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798080 00000100:00100000:3.0:1788592706.720064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 278 00000100:00100000:3.0:1788592706.720077:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:9966:x1875475136798080:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788592706.720474:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:9966:x1875475136798080:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 398us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592706.720483:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 278 00010000:00010000:3.0:1788592706.815102:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592707.263614:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592707.838592:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592708.350522:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592708.350565:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147317632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592708.350670:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592708.350764:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592708.350790:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592708.350937:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317632 00000100:00100000:1.0:1788592708.350946:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317632 00000100:00100000:1.0:1788592708.351020:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317504 00000100:00100000:1.0:1788592708.351023:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317504 00000100:00100000:0.0:1788592708.351026:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788592708.351039:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147317632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592708.351042:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788592708.351047:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147317504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592708.351087:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00002000:00000024:0.0:1788592708.351087:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592708.351139:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147317632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592708.351146:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788592708.351216:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592708.351221:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592708.351250:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147317760:0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.351298:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592708.351322:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592708.351328:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147317888:0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.351396:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592708.351424:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317888 00000100:00100000:3.0:1788592708.351428:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317888 00000100:00100000:3.0:1788592708.351457:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788592708.351464:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147317888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.351499:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147317888:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592708.351506:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788592708.351553:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147317888:0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.351605:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147317760 00000100:00100000:3.0:1788592708.351609:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147317760 00000100:00100000:3.0:1788592708.351633:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788592708.351639:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147317760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.351672:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147317760:12345-0@lo:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592708.351678:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788592708.351708:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147317760:0@lo:400:kworker.0 00000100:00100000:1.0:1788592708.357283:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147317504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6210us (6466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592708.357327:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788592708.364323:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147317632:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788592708.364389:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15df80 x1875475147317504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592708.364407:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147317504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592708.364457:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147318016:0@lo:400:kworker.0 00000100:00100000:0.0:1788592708.364552:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592708.365162:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318016 00000100:00100000:3.0:1788592708.365174:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318016 00000100:00100000:3.0:1788592708.365258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788592708.365280:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147318016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592708.365364:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147318144:0@lo:400:kworker.0 00000100:00100000:3.0:1788592708.365365:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147318016:12345-0@lo:400:kworker.0 Request processed in 70us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592708.365373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788592708.365409:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592708.365443:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318144 00000100:00100000:2.0:1788592708.365447:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318144 00000100:00100000:2.0:1788592708.365478:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788592708.365485:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147318144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592708.365517:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147318144:12345-0@lo:400:kworker.0 Request processed in 32us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592708.365524:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788592708.366131:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592708.366244:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147318144:0@lo:400:kworker.0 00000100:00100000:1.0:1788592708.366570:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147318016:0@lo:400:kworker.0 00010000:00010000:3.0:1788592708.862666:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592709.628903:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592709.628976:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592709.629024:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592709.629058:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798336 00000100:00100000:0.0:1788592709.629080:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798336 00000100:00100000:3.0:1788592709.629093:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798592 00000100:00100000:3.0:1788592709.629105:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798592 00000100:00100000:2.0:1788592709.629138:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592709.629175:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798464 00000100:00100000:2.0:1788592709.629180:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798464 00000100:00100000:3.0:1788592709.629191:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1788592709.629206:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136798592:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592709.629225:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:2.0:1788592709.629236:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136798464:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592709.629327:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136798464:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592709.629335:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1788592709.629588:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:0.0:1788592709.629604:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136798336:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592709.629688:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798208 00000100:00100000:1.0:1788592709.629694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798208 00000100:00100000:1.0:1788592709.629731:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:1.0:1788592709.629738:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136798208:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592709.637439:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136798336:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7817us (8529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592709.637445:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136798208:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 7693us (8407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592709.637477:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 280 00000100:00100000:0.0:1788592709.637486:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00080000:0.0:1788592709.637579:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592709.637588:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592709.639889:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136798592:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 10668us (10892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592709.639909:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00010000:00010000:3.0:1788592709.887720:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592710.914485:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592711.939430:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592712.964495:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592713.470803:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147318272:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.470912:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.470982:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147318784:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471013:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.471047:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788592713.471054:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147318400:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471077:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.471095:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147318912:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471119:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.471151:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147318656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471189:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.471209:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592713.471214:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147318528:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471235:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592713.471265:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318784 00000100:00100000:3.0:1788592713.471274:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318784 00000100:00100000:3.0:1788592713.471388:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318400 00000100:00100000:3.0:1788592713.471392:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318400 00000100:00100000:3.0:1788592713.471407:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318528 00000100:00100000:3.0:1788592713.471410:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318528 00000100:00100000:3.0:1788592713.471427:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788592713.471435:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147318784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471500:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147318784:12345-0@lo:400:kworker.0 Request processed in 65us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592713.471507:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788592713.471527:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788592713.471533:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147318400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471561:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147318400:12345-0@lo:400:kworker.0 Request processed in 28us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592713.471567:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788592713.471578:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788592713.471583:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147318528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471614:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147318528:12345-0@lo:400:kworker.0 Request processed in 31us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592713.471620:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788592713.471640:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318912 00000100:00100000:3.0:1788592713.471643:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318912 00000100:00100000:3.0:1788592713.471669:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318656 00000100:00100000:3.0:1788592713.471673:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318656 00000100:00100000:3.0:1788592713.471692:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592713.471698:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147318912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471729:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147318912:12345-0@lo:400:kworker.0 Request processed in 31us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592713.471746:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788592713.471756:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592713.471761:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147318656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471791:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147318656:12345-0@lo:400:kworker.0 Request processed in 30us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592713.471796:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788592713.471860:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147318528:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471872:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147318656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471904:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb363100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147318400:0@lo:400:kworker.0 00010000:00080000:3.0:1788592713.471917:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb361f80 x1875475147318912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592713.471928:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147318912:0@lo:400:kworker.0 00000100:00100000:3.0:1788592713.471938:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb363480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147318784:0@lo:400:kworker.0 00000100:00080000:0.0:1788592713.472332:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592713.472338:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592713.472341:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592713.472682:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592713.472699:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147319040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592713.472752:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592713.472931:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147318272 00000100:00100000:2.0:1788592713.472938:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147318272 00000100:00100000:2.0:1788592713.472990:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788592713.472999:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147318272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592713.473049:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147318272:12345-0@lo:400:kworker.0 Request processed in 52us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592713.473056:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788592713.473664:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319040 00000100:00100000:0.0:1788592713.473671:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319040 00000100:00100000:0.0:1788592713.473723:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788592713.473731:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147319040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592713.473848:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592713.473918:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147319040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (1165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592713.473925:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592713.474526:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb363b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147318272:0@lo:400:kworker.0 00000100:00100000:1.0:1788592713.477246:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147319168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592713.477400:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592713.477507:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147319040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592713.477563:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319168 00000100:00100000:1.0:1788592713.477572:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319168 00000100:00100000:1.0:1788592713.477633:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788592713.477643:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147319168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592713.477692:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592713.477750:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147319168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592713.477758:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788592713.477825:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898184e58e00 x1875475147319168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592713.477865:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147319168:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788592713.984014:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592714.725841:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592714.725911:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592714.725944:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592714.725987:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592714.726081:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798848 00000100:00100000:2.0:1788592714.726096:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798848 00000100:00100000:0.0:1788592714.726168:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798720 00000100:00100000:0.0:1788592714.726175:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798720 00000100:00100000:2.0:1788592714.726201:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799104 00000100:00100000:2.0:1788592714.726207:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799104 00000100:00100000:0.0:1788592714.726223:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:0.0:1788592714.726236:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136798720:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592714.726257:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1788592714.726267:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136798848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592714.726378:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136798976 00000100:00100000:3.0:1788592714.726384:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136798976 00000100:00100000:3.0:1788592714.726419:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1788592714.726427:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136798976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592714.726511:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136798720:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 277us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592714.726537:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 282 00000100:00100000:0.0:1788592714.726593:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1788592714.726601:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136799104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:1.0:1788592714.727642:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788592714.727650:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592714.728786:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136798848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 2505us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592714.728804:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:3.0:1788592714.734459:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136798976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 8010us (8536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592714.734480:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1788592714.739117:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136799104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 12491us (13103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592714.739139:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00010000:00010000:3.0:1788592715.008641:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592716.030538:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592717.054535:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592717.503864:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592718.081298:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592718.590752:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147319296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592718.590852:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592718.590976:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319296 00000100:00100000:2.0:1788592718.590987:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319296 00000100:00100000:2.0:1788592718.591082:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592718.591094:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147319296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592718.591140:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592718.591195:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147319296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592718.591203:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592718.591240:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147319424:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788592718.591297:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592718.591300:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147319296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592718.591437:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592718.591563:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319424 00000100:00100000:0.0:1788592718.591568:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319424 00000100:00100000:0.0:1788592718.591614:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788592718.591621:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147319424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592718.591644:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592718.591676:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147319424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592718.591684:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788592718.591739:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788592718.591760:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898184e59180 x1875475147319424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592718.591776:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147319424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592718.592171:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147319552:0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.592207:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592718.592242:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592718.592247:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147319680:0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.592272:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592718.592319:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319680 00000100:00100000:0.0:1788592718.592323:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319680 00000100:00100000:0.0:1788592718.592388:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788592718.592395:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147319680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.592432:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147319680:12345-0@lo:400:kworker.0 Request processed in 37us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592718.592439:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788592718.592731:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319552 00000100:00100000:3.0:1788592718.592736:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319552 00000100:00100000:3.0:1788592718.592768:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788592718.592774:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147319552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592718.592807:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147319552:12345-0@lo:400:kworker.0 Request processed in 33us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592718.592813:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788592718.592877:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147319680:0@lo:400:kworker.0 00000100:00100000:3.0:1788592718.592886:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147319552:0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.593470:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147319936:0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.593506:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592718.593537:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592718.593542:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147319808:0@lo:400:kworker.0 00000100:00100000:0.0:1788592718.593564:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592718.593630:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319936 00000100:00100000:2.0:1788592718.593635:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319936 00000100:00100000:2.0:1788592718.593679:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147319808 00000100:00100000:2.0:1788592718.593682:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147319808 00000100:00100000:2.0:1788592718.593701:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788592718.593708:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592718.593748:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147319936:12345-0@lo:400:kworker.0 Request processed in 42us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592718.593755:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788592718.593767:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788592718.593772:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147319808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592718.593793:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147319808:12345-0@lo:400:kworker.0 Request processed in 21us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592718.593813:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788592718.593840:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147319808:0@lo:400:kworker.0 00000100:00100000:2.0:1788592718.593849:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147319936:0@lo:400:kworker.0 00000100:00080000:0.0:1788592718.594130:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592719.104442:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592719.844746:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592719.844892:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592719.845087:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799360 00000100:00100000:3.0:1788592719.845099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799360 00000100:00100000:3.0:1788592719.845186:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:3.0:1788592719.845197:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136799360:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592719.845304:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136799360:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 109us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592719.845312:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00080000:0.0:1788592719.845768:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592719.846018:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799232 00000100:00100000:1.0:1788592719.846025:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799232 00000100:00100000:1.0:1788592719.846117:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:1.0:1788592719.846126:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136799232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592719.846185:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184f52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136799232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 61us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592719.846192:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 284 00000100:00100000:2.0:1788592719.855019:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592719.855083:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592719.855177:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799616 00000100:00100000:0.0:1788592719.855191:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799616 00000100:00100000:0.0:1788592719.855283:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1788592719.855294:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136799616:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592719.855415:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136799616:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592719.855423:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00080000:2.0:1788592719.856015:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592719.856126:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799488 00000100:00100000:3.0:1788592719.856133:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799488 00000100:00100000:3.0:1788592719.856189:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592719.856197:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2340:x1875475136799488:12345-192.168.204.20@tcp:9:kworker.0 00000020:00000080:3.0:1788592719.856230:0:8688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510ba5 00000100:00080000:3.0:1788592719.856256:0:8688:0:(import.c:65:import_set_state_nolock()) ffff8981bbb8d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592719.856309:0:8688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788592719.856901:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788592719.856950:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788592719.857019:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+2:2340:x1875475136799488:12345-192.168.204.20@tcp:9:kworker.0 Request processed in 820us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592719.857029:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:3.0:1788592720.128432:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592721.151501:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592722.174663:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592723.199525:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788592723.288171:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:1.0:1788592723.288185:0:6703:0:(genops.c:885:class_export_put()) final put ffff8981bbb8e800/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:3.0:1788592723.290344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bbb8e800/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-OST0000 00000020:00000080:3.0:1788592723.290490:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981bbb8d000 for lustre-OST0000 00000100:00100000:0.0:1788592723.711017:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147320064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592723.711118:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592723.711188:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147320576:0@lo:400:kworker.0 00000100:00100000:0.0:1788592723.711210:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592723.711233:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788592723.711238:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147320192:0@lo:400:kworker.0 00000100:00100000:0.0:1788592723.711263:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592723.711302:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147320704:0@lo:400:kworker.0 00000100:00100000:0.0:1788592723.711325:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592723.711373:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320192 00000100:00100000:0.0:1788592723.711381:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320192 00000100:00100000:0.0:1788592723.711423:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788592723.711432:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147320192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592723.711481:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147320192:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592723.711489:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788592723.711538:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147320192:0@lo:400:kworker.0 00000100:00100000:3.0:1788592723.711754:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320064 00000100:00100000:3.0:1788592723.711759:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320064 00000100:00100000:3.0:1788592723.711807:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788592723.711814:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147320064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592723.711850:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592723.711886:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147320064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592723.711892:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788592723.711914:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320704 00000100:00100000:3.0:1788592723.711917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320704 00000100:00100000:3.0:1788592723.711945:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788592723.711952:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147320704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592723.711994:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147320704:12345-0@lo:400:kworker.0 Request processed in 43us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592723.712000:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788592723.712164:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147320704:0@lo:400:kworker.0 00000100:00100000:0.0:1788592723.712183:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147320064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592723.712322:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147320448:0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.712382:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592723.712408:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788592723.712416:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147320320:0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.712440:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592723.712460:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147320832:0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.712482:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592723.712509:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320576 00000100:00100000:2.0:1788592723.712514:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320576 00000100:00100000:2.0:1788592723.712539:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320832 00000100:00100000:2.0:1788592723.712542:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320832 00000100:00100000:2.0:1788592723.712597:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592723.712605:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147320576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.712647:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147320576:12345-0@lo:400:kworker.0 Request processed in 43us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592723.712654:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788592723.712683:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788592723.712689:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147320832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.712726:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147320832:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592723.712733:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788592723.712751:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592723.712756:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592723.712759:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592723.712770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320448 00000100:00100000:2.0:1788592723.712774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320448 00000100:00100000:2.0:1788592723.713016:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320320 00000100:00100000:2.0:1788592723.713020:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320320 00000100:00100000:2.0:1788592723.713032:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788592723.713038:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147320448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.713142:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147320448:12345-0@lo:400:kworker.0 Request processed in 34us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592723.713151:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788592723.713167:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788592723.713174:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147320320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.713210:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147320320:12345-0@lo:400:kworker.0 Request processed in 37us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592723.713216:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788592723.713248:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592723.713276:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147320320:0@lo:400:kworker.0 00010000:00080000:2.0:1788592723.713292:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb249180 x1875475147320832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788592739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592723.713304:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147320832:0@lo:400:kworker.0 00000100:00100000:2.0:1788592723.713330:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147320448:0@lo:400:kworker.0 00000100:00100000:1.0:1788592723.713931:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592723.713945:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147320960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592723.714178:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592723.714383:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147320576:0@lo:400:kworker.0 00000100:00100000:3.0:1788592723.714449:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147320960 00000100:00100000:3.0:1788592723.714455:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147320960 00000100:00100000:3.0:1788592723.714499:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788592723.714516:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147320960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592723.714575:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592723.714623:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147320960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592723.714630:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788592723.714901:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bb248a80 x1875475147320960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592723.714919:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147320960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788592724.223472:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592724.974567:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592724.974638:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592724.974676:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592724.974708:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799744 00000100:00100000:2.0:1788592724.974721:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799744 00000100:00100000:2.0:1788592724.974794:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 286 00000100:00100000:2.0:1788592724.975264:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136799744:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592724.975386:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136799744:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 128us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592724.975394:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 286 00000100:00100000:2.0:1788592724.975437:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136799872 00000100:00100000:2.0:1788592724.975442:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136799872 00000100:00100000:2.0:1788592724.975482:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800000 00000100:00100000:2.0:1788592724.975485:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800000 00000100:00100000:2.0:1788592724.975509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:2.0:1788592724.975517:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136799872:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592724.975572:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136799872:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592724.975578:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:2.0:1788592724.975591:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1788592724.975597:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136800000:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592724.975717:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136800000:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592724.975727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00080000:2.0:1788592724.976043:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592725.248749:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592726.272321:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592727.295324:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592727.744255:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592728.319953:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592728.830660:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147321088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592728.830758:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592728.830929:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321088 00000100:00100000:1.0:1788592728.830947:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321088 00000100:00100000:2.0:1788592728.830978:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592728.831007:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592728.831015:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321216 00000100:00100000:1.0:1788592728.831018:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321216 00000100:00100000:1.0:1788592728.831047:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592728.831059:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147321088:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592728.831065:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592728.831070:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592728.831082:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592728.831090:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147321216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592728.831106:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00002000:00000024:0.0:1788592728.831110:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592728.831161:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147321088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592728.831171:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788592728.833620:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147321472:0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.833728:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592728.833783:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788592728.833790:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147321344:0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.833825:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592728.833888:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321472 00000100:00100000:3.0:1788592728.833898:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321472 00000100:00100000:3.0:1788592728.833959:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788592728.833970:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147321472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.834143:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147321472:12345-0@lo:400:kworker.0 Request processed in 174us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592728.834328:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788592728.834384:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321344 00000100:00100000:3.0:1788592728.834388:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321344 00000100:00100000:3.0:1788592728.834417:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788592728.834423:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147321344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.834459:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147321344:12345-0@lo:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592728.834485:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788592728.834540:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147321344:0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.834557:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147321472:0@lo:400:kworker.0 00000100:00100000:0.0:1788592728.834794:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147321216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3703us (3784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592728.834805:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592728.834855:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147321600:0@lo:400:kworker.0 00000100:00100000:0.0:1788592728.834916:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592728.834964:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147321088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592728.834992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321600 00000100:00100000:0.0:1788592728.834997:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321600 00000100:00100000:0.0:1788592728.835052:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788592728.835060:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147321600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592728.835099:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147321600:12345-0@lo:400:kworker.0 Request processed in 40us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592728.835106:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1788592728.835125:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592728.835148:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147321600:0@lo:400:kworker.0 00010000:00080000:2.0:1788592728.838013:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898184e58e00 x1875475147321216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592728.838128:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147321216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592728.843343:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592728.843391:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147321728:0@lo:400:kworker.0 00000100:00100000:1.0:1788592728.843487:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592728.843656:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321728 00000100:00100000:3.0:1788592728.843666:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321728 00000100:00100000:3.0:1788592728.843742:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788592728.843752:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147321728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592728.843817:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147321728:12345-0@lo:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592728.843825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788592728.844383:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592728.844804:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147321728:0@lo:400:kworker.0 00000001:02000400:3.0:1788592729.253029:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:18:46 (1788592726) 00010000:00010000:1.0:1788592729.345723:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592730.105459:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592730.105513:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592730.105550:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592730.105593:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800384 00000100:00100000:0.0:1788592730.105608:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800384 00000100:00100000:0.0:1788592730.105699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800256 00000100:00100000:0.0:1788592730.105703:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800256 00000100:00100000:0.0:1788592730.105731:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:0.0:1788592730.105742:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136800384:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592730.105871:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136800384:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 130us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592730.105879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:0.0:1788592730.105900:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:0.0:1788592730.105906:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136800256:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592730.105933:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136800256:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592730.105939:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00080000:1.0:1788592730.106026:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592730.106620:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800128 00000100:00100000:2.0:1788592730.106637:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800128 00000100:00100000:2.0:1788592730.106687:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 288 00000100:00100000:2.0:1788592730.106695:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136800128:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592730.106737:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136800128:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 44us (1305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592730.106743:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 288 00010000:00010000:3.0:1788592730.367167:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592731.390882:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592731.550900:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592731.551006:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800512 00000100:00100000:0.0:1788592731.551018:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800512 00000100:00100000:0.0:1788592731.551092:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1788592731.551104:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:10235:x1875475136800512:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592731.551127:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592731.551232:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19c5 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551476:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551492:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551506:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592731.551547:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592731.551552:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592731.551597:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551625:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19c5 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551646:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19c5 expref: 6 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.551656:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592731.551659:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592731.551679:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb400, rc 0) 00000100:00100000:0.0:1788592731.551753:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:10235:x1875475136800512:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 651us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592731.551761:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:3.0:1788592731.579085:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592731.579216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800640 00000100:00100000:0.0:1788592731.579228:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800640 00000100:00100000:0.0:1788592731.579318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1788592731.579332:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:10236:x1875475136800640:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592731.579399:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592731.579433:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510c7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19cc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579516:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579532:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579544:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579558:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579565:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579572:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579817:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579844:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579851:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592731.579885:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592731.579889:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592731.579912:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579923:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579929:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579936:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579941:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592731.579945:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579952:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579964:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592731.579967:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592731.579971:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.579987:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580001:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580006:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580011:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580016:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccae00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592731.580019:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580025:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580032:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff898185c2d100) 00010000:00010000:0.0:1788592731.580035:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592731.580037:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580042:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510c8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580074:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510c7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19cc expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580087:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19cc expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592731.580100:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff898185c2db00) 00010000:00010000:0.0:1788592731.580103:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592731.580105:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb800, rc 0) 00000100:00100000:0.0:1788592731.580192:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:10236:x1875475136800640:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 864us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592731.580200:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1788592731.594850:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592731.596107:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136800896 00000100:00100000:0.0:1788592731.596122:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136800896 00000100:00100000:3.0:1788592731.596437:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:3.0:1788592731.596463:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:10236:x1875475136800896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592731.596488:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592731.596514:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c9a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19d3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596597:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596614:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596626:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596688:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596696:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.596703:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.597094:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5c00/0x27b316f132510caf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.597104:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5c00/0x27b316f132510caf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.597112:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5c00/0x27b316f132510caf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592731.597124:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788592731.598091:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598104:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598110:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598116:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592731.598121:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598628:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598646:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff898185c2db00) 00010000:00010000:3.0:1788592731.598649:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592731.598654:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598661:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132510ca1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598681:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598686:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598692:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598697:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592731.598700:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598706:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598712:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8981898bfa00) 00010000:00010000:3.0:1788592731.598715:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592731.598717:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.598733:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132510ca8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.599793:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132510c9a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19d3 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.599816:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5c00/0x27b316f132510caf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19d3 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592731.601045:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:3.0:1788592731.601050:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592731.601054:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5c00, rc 0) 00000100:00100000:3.0:1788592731.601265:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10236:x1875475136800896:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4803us (6421us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788592731.601277:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1788592731.614910:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592731.615124:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801024 00000100:00100000:0.0:1788592731.615137:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801024 00000100:00100000:0.0:1788592731.615214:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1788592731.615227:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10236:x1875475136801024:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788592731.615865:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10236:x1875475136801024:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 195us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592731.615877:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000040:00080000:1.0:1788592731.839872:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788592732.417936:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592732.965573:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:2.0:1788592733.444607:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592733.952662:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592733.952694:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147321856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592733.953046:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.953127:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321856 00000100:00100000:1.0:1788592733.953136:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321856 00000100:00100000:1.0:1788592733.953198:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788592733.953209:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147321856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592733.953267:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592733.953319:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147321856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592733.953327:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788592733.953376:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788592733.953643:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981886f3480 x1875475147321856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592733.953672:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147321856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592733.953919:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147321984:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.953962:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.954003:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147322496:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.954030:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.954055:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592733.954061:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147322368:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.954087:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.954118:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147322112:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.954144:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.954165:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592733.954170:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147322240:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.954216:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.954252:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147322368 00000100:00100000:1.0:1788592733.954259:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147322368 00000100:00100000:1.0:1788592733.954306:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592733.954314:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147322368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592733.954595:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147321984 00000100:00100000:2.0:1788592733.954601:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147321984 00000100:00100000:2.0:1788592733.954652:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788592733.954661:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147321984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592733.954697:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147321984:12345-0@lo:400:kworker.0 Request processed in 38us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592733.954728:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788592733.955100:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147322368:12345-0@lo:400:kworker.0 Request processed in 95us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592733.955115:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788592733.955145:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147322496 00000100:00100000:1.0:1788592733.955150:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147322496 00000100:00100000:1.0:1788592733.955192:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147322112 00000100:00100000:1.0:1788592733.955196:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147322112 00000100:00100000:1.0:1788592733.955209:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147322240 00000100:00100000:1.0:1788592733.955211:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147322240 00000100:00100000:1.0:1788592733.955226:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788592733.955233:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147322496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.955273:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147322496:12345-0@lo:400:kworker.0 Request processed in 42us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592733.955279:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788592733.955291:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788592733.955297:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147322112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.955329:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147322112:12345-0@lo:400:kworker.0 Request processed in 32us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592733.955335:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788592733.955346:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788592733.956559:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147322240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.956928:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147322240:12345-0@lo:400:kworker.0 Request processed in 379us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592733.956938:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1788592733.956977:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592733.956983:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592733.957033:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147322368:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.957048:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147321984:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.957074:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147322496:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.957121:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147322240:0@lo:400:kworker.0 00000100:00100000:1.0:1788592733.957134:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147322112:0@lo:400:kworker.0 00000100:00100000:0.0:1788592733.959550:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147322624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592733.959941:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592733.968550:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147322624 00000100:00100000:1.0:1788592733.968576:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147322624 00000100:00100000:0.0:1788592733.969880:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788592733.969898:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147322624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592733.969955:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592733.970399:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147322624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 504us (10456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592733.970416:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592733.974819:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147322624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592734.136001:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592734.136100:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801152 00000100:00100000:0.0:1788592734.136126:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801152 00000100:00100000:0.0:1788592734.136229:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1788592734.136242:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10279:x1875475136801152:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592734.136269:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592734.136298:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510cbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19da expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136408:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136426:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136443:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136460:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136467:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136473:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136750:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136760:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136767:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136792:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592734.136798:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136807:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136823:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592734.136826:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592734.136834:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136841:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136855:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136861:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136868:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136874:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccae00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592734.136877:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136883:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136903:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff898185c2d200) 00010000:00010000:0.0:1788592734.136905:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592734.136908:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136913:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136955:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510cbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19da expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136965:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592734.136967:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592734.136971:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19da expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.136981:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbe00, rc 0) 00000100:00100000:0.0:1788592734.137067:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10279:x1875475136801152:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 829us (1081us total) trans 0 rc 301/301 00000100:00100000:0.0:1788592734.137075:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00080000:2.0:1788592734.137545:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592734.151579:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.152601:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801408 00000100:00100000:3.0:1788592734.152617:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801408 00000100:00100000:3.0:1788592734.152844:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1788592734.152858:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10279:x1875475136801408:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:3.0:1788592734.152945:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592734.152984:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510c77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19c5 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.153011:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592734.153026:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592734.153344:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.155622:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.155640:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.156104:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.156116:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.156126:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592734.160856:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788592734.160882:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160893:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160903:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160923:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592734.160928:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160938:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160961:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:0.0:1788592734.160964:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592734.160971:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.160979:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510cd2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592734.161008:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e93d631 reply state 000000008b1342b8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592734.161019:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592734.161165:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10279:x1875475136801408:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 8305us (9598us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788592734.161176:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00010000:00010000:1.0:1788592734.166902:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.166926:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.166934:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.166941:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592734.166947:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.166956:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.166992:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89818289a400) 00010000:00010000:1.0:1788592734.166996:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592734.167002:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.167010:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510cd9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592734.275799:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592734.292206:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801536 00000100:00100000:0.0:1788592734.292229:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801536 00000100:00100000:0.0:1788592734.292324:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:0.0:1788592734.292336:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10287:x1875475136801536:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:0.0:1788592734.292397:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592734.292431:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19e1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.292562:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.292580:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.292592:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592734.294762:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592734.294787:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592734.294865:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.294923:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e1 expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.294954:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e1 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.294965:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592734.294968:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592734.294974:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592734.295079:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10287:x1875475136801536:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 2743us (19293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592734.295090:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1788592734.352860:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.352924:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801664 00000100:00100000:2.0:1788592734.352938:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801664 00000100:00100000:2.0:1788592734.353008:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1788592734.353020:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:10293:x1875475136801664:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592734.353048:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592734.353075:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19e8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353165:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353185:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353198:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353215:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353222:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.353250:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355153:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355180:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355195:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592734.355239:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788592734.355244:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592734.355291:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355307:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355314:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355321:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355328:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592734.355333:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.355342:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.356305:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:2.0:1788592734.356309:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592734.356317:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.356325:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132510cf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357115:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357131:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357140:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357146:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592734.357150:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357160:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357172:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8981a1fe1500) 00010000:00010000:2.0:1788592734.357175:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592734.357180:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357188:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510cfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357274:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e8 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357291:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e8 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.357299:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592734.357301:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788592734.357304:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4400, rc 0) 00000100:00100000:0.0:1788592734.357602:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:10293:x1875475136801664:12345-192.168.204.20@tcp:101:bash.0 Request processed in 4580us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592734.357985:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:0.0:1788592734.362183:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.364820:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136801920 00000100:00100000:2.0:1788592734.364841:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136801920 00000100:00100000:2.0:1788592734.364934:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1788592734.364947:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+10:10293:x1875475136801920:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592734.364976:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592734.365008:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510d0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19ef expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367556:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367588:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367605:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367808:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367835:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.367854:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592734.369442:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788592734.371449:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371476:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371489:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371546:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371569:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371577:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371584:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592734.371589:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371598:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371612:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592734.371615:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592734.371620:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371627:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592734.371645:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5b44e4e reply state 0000000008b41473 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592734.371657:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592734.371700:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510d0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371720:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.371739:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:0.0:1788592734.371742:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592734.371745:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592734.371852:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10293:x1875475136801920:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6907us (9698us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788592734.371862:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1788592734.381340:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.381440:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802048 00000100:00100000:3.0:1788592734.381532:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802048 00010000:00010000:2.0:1788592734.381604:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.381606:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592734.381625:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875475136802048:12345-192.168.204.20@tcp:8:bash.0 00010000:00010000:2.0:1788592734.381628:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.381645:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.381653:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592734.381659:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788592734.381679:0:8688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 308 last 0 00010000:00010000:2.0:1788592734.381699:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.381720:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d100) 00010000:00010000:2.0:1788592734.381723:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592734.381728:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788592734.381731:0:8688:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f132510d2d 00010000:00010000:2.0:1788592734.381742:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132510d18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788592734.381753:0:8688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 551ef727-4fdd-447b-98b8-d223b2dddab7/ffff8981bc84d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788592734.382577:0:8688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788592734.382927:0:8688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788592734.382990:0:8688:0:(import.c:65:import_set_state_nolock()) ffff8981bc84c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788592734.383092:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136802048:12345-192.168.204.20@tcp:8:bash.0 Request processed in 1468us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.383104:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1788592734.386501:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592734.386723:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802176 00000100:00100000:1.0:1788592734.386735:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802176 00000100:00100000:1.0:1788592734.386895:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1788592734.386908:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:0:x1875475136802176:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592734.386928:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592734.386957:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19f6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592734.386989:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788592734.387012:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1788592734.387017:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592734.387027:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.387057:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.387074:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be600, rc 0) 00000100:00080000:2.0:1788592734.387246:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592734.389410:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:0:x1875475136802176:12345-192.168.204.20@tcp:101:bash.0 Request processed in 2490us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592734.389424:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1788592734.392917:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592734.393604:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802304 00000100:00100000:0.0:1788592734.393620:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802304 00000100:00100000:0.0:1788592734.393701:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1788592734.393714:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:10293:x1875475136802304:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592734.393740:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592734.393780:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d19fd expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.393819:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.393829:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592734.393834:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592734.393840:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.393885:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.393919:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 8 pid: 6677 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592734.393936:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875475147322752:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592734.394066:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905dbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592734.398811:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.398911:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802432 00000100:00100000:3.0:1788592734.398925:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802432 00010000:00010000:3.0:1788592734.399034:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 9 pid: 6677 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.399089:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:3.0:1788592734.399119:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136802432:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592734.399138:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592734.399170:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 9 pid: 6677 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.399187:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 9 pid: 6677 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.399221:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592734.399227:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592734.399239:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.399250:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.399295:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.399312:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147322880:192.168.204.20@tcp:105: 00000100:00100000:3.0:1788592734.399500:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819019a240 going to sleep for 11 seconds 00010000:00010000:2.0:1788592734.399775:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f132510d34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19f6 expref: 9 pid: 6677 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592734.399815:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875475147322752:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592734.399853:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.399867:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca600, rc 0) 00000100:00100000:2.0:1788592734.399936:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10293:x1875475136802304:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6224us (7036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592734.399946:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1788592734.414005:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147322880:192.168.204.20@tcp:105: 00010000:00010000:3.0:1788592734.414039:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592734.414116:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136802432:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 14997us (15322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.414150:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1788592734.417345:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.418130:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802688 00000100:00100000:3.0:1788592734.418144:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802688 00000100:00100000:3.0:1788592734.418226:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1788592734.418239:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+12:10293:x1875475136802688:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1788592734.418691:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10293:x1875475136802688:12345-192.168.204.20@tcp:35:bash.0 Request processed in 454us (1355us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788592734.418701:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00010000:00010000:3.0:1788592734.462713:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592734.565014:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.565178:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136802944 00000100:00100000:2.0:1788592734.565197:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136802944 00000100:00100000:2.0:1788592734.565299:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1788592734.565312:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10303:x1875475136802944:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592734.565405:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592734.565436:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a04 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592734.565793:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788592734.565981:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a04 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.565999:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:2.0:1788592734.566003:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592734.566009:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a04 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.566170:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592734.566265:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10303:x1875475136802944:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 955us (1261us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788592734.566274:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:0.0:1788592734.571221:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.571675:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136803200 00000100:00100000:2.0:1788592734.571689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136803200 00000100:00100000:2.0:1788592734.571759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1788592734.571785:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10303:x1875475136803200:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592734.572125:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10303:x1875475136803200:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 344us (930us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788592734.572135:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592734.684334:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.684563:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136803328 00000100:00100000:3.0:1788592734.684576:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136803328 00000100:00100000:3.0:1788592734.684670:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:3.0:1788592734.684683:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10309:x1875475136803328:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592734.684711:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592734.684736:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a0b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.684834:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.684849:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.684863:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592734.684908:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788592734.684930:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592734.684962:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.684992:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a0b expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.685320:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a0b expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.685329:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592734.685331:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592734.685336:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592734.685455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+16:10309:x1875475136803328:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 774us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.685466:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1788592734.695678:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.695784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136803584 00000100:00100000:3.0:1788592734.695795:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136803584 00000100:00100000:3.0:1788592734.695863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:3.0:1788592734.695875:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+16:10309:x1875475136803584:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592734.695896:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592734.695922:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510d5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a12 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.696031:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510d65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.696046:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.696078:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592734.696090:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788592734.696265:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510d5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a12 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.696288:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a12 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.696297:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592734.696300:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592734.696304:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592734.696424:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+18:10309:x1875475136803584:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 551us (758us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788592734.696432:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1788592734.704827:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.704980:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136803712 00000100:00100000:2.0:1788592734.704996:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136803712 00000100:00100000:2.0:1788592734.705091:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1788592734.705119:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2341:x1875475136803712:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592734.705141:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592734.705174:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510d65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a12 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.705200:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592734.705207:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592734.705293:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+17:2341:x1875475136803712:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 175us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592734.705310:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1788592734.709667:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592734.709850:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136803968 00000100:00100000:0.0:1788592734.709865:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136803968 00000100:00100000:0.0:1788592734.709937:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:0.0:1788592734.709949:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+17:10309:x1875475136803968:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592734.709981:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592734.710008:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510d73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a19 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.710134:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.710152:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.710165:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592734.710204:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788592734.710415:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510d73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a19 expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.710752:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a19 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.710774:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:0.0:1788592734.710777:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788592734.710781:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbe00, rc 0) 00000100:00100000:0.0:1788592734.710850:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10309:x1875475136803968:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 902us (1200us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788592734.710858:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1788592734.722734:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.723226:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804096 00000100:00100000:3.0:1788592734.723240:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804096 00000100:00100000:3.0:1788592734.723411:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1788592734.723436:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136804096:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:3.0:1788592734.723504:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.723529:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.723539:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592734.723564:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592734.723571:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.723619:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.723637:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 7 pid: 6678 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.723655:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147323008:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592734.723787:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819019a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788592734.731842:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.733482:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804224 00000100:00100000:2.0:1788592734.733503:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804224 00002000:00100000:2.0:1788592734.733576:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8981bf4aa680 x1875475136804224/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:10/0 lens 504/0 e 0 to 0 dl 1788592745 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592734.733589:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bf4aa680 with x1875475136804224 ext(0->12) 00010000:00010000:2.0:1788592734.733600:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 8 pid: 6678 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.733621:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 8 pid: 6678 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592734.733630:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bf4aa680 00000100:00100000:2.0:1788592734.733686:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592734.733697:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136804224:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:3.0:1788592734.734852:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147323008:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592734.734890:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1788592734.799190:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000100:00100000:0.0:1788592734.801166:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136804224:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 67452us (69329us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788592734.801195:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:0.0:1788592734.801213:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8981bf4aa680 x1875475136804224/t4294967299(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:10/0 lens 504/448 e 0 to 0 dl 1788592745 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592734.801225:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bf4aa680 with x1875475136804224 ext(0->12) 00010000:00010000:0.0:1788592734.801238:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592734.801260:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592734.801287:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bf4aa680 00000100:00100000:0.0:1788592734.806339:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.806590:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804352 00000100:00100000:3.0:1788592734.806604:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804352 00010000:00010000:3.0:1788592734.806672:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.806729:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1788592734.806742:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2342:x1875475136804352:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592734.806770:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788592734.806800:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788592734.806804:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788592733 00002000:00010000:3.0:1788592734.806822:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788592733 00002000:00010000:3.0:1788592734.806824:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788592733 00010000:00010000:3.0:1788592734.806833:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.806851:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.806894:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5d339d3/0x27b316f132510d3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19fd expref: 9 pid: 6678 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.806918:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1788592734.806924:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592734.806931:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.806944:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.806983:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592734.807241:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2342:x1875475136804352:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 499us (917us total) trans 0 rc 0/0 00010000:00010000:1.0:1788592734.807246:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.807263:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00010000:00010000:1.0:1788592734.807264:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807297:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807306:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807313:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807320:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4a00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592734.807325:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807370:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807385:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592734.807392:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bcf22e5/0x27b316f132510d88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592734.807454:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136804096:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 84032us (84735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592734.807463:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1788592734.812570:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592734.812680:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804608 00000100:00100000:0.0:1788592734.812695:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804608 00000100:00100000:0.0:1788592734.812774:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:0.0:1788592734.812788:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10309:x1875475136804608:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:0.0:1788592734.812949:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a19 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592734.819977:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788592734.820139:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788592734.820861:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788592734.820939:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.820965:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.820976:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.821030:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 23 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.821049:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 23 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592734.821066:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147323136:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592734.821191:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819128b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592734.827829:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147323136:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592734.827873:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592734.835497:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.836231:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804736 00000100:00100000:2.0:1788592734.836245:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804736 00010000:00010000:2.0:1788592734.836305:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 24 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592734.836389:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1788592734.836402:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+24:2343:x1875475136804736:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592734.836448:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592734.836458:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 24 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836475:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 24 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836503:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19ef expref: 24 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836524:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592734.836531:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836542:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836550:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.836702:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592734.836793:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+23:2343:x1875475136804736:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 392us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592734.836802:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00010000:00010000:3.0:1788592734.840276:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.840300:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592734.841820:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788592734.842137:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788592734.842321:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147323264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592734.843002:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592734.843069:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185a1a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788592734.843574:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147323264 00000100:00100000:0.0:1788592734.843586:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147323264 00000100:00100000:0.0:1788592734.843667:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788592734.843679:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147323264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592734.843827:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147323264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 150us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592734.843835:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592734.844102:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147323264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788592734.847925:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788592734.848081:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147323392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592734.848180:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592734.848230:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819128b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788592734.848418:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147323392 00000100:00100000:0.0:1788592734.848428:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147323392 00000100:00100000:0.0:1788592734.848502:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592734.848515:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147323392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592734.848801:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5826:x1875475147323392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 288us (619us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788592734.848810:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592734.849254:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e95500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147323392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788592734.849332:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788592734.849475:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849489:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849499:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849506:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592734.849513:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849522:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849543:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592734.849546:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788592734.849552:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592734.849560:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132510d8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592734.849975:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788592734.850748:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788592734.850782:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309091431860ns, next at 310091427623ns, rc = 0 00000001:00080000:2.0:1788592734.850794:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788592734.850952:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592734.850957:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788592734.850969:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510d7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a19 expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592734.851413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:10309:x1875475136804608:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 38625us (38856us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788592734.851423:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000020:00080000:2.0:1788592734.851429:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788592734.860470:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.860718:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136804864 00000100:00100000:3.0:1788592734.860732:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136804864 00000100:00100000:3.0:1788592734.860814:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1788592734.860827:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:10309:x1875475136804864:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592734.860868:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592734.860900:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a20 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.860983:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a20 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.861002:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a20 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.861038:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592734.861043:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592734.861048:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5200, rc 0) 00000100:00100000:3.0:1788592734.861132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+27:10309:x1875475136804864:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 306us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.861140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:0.0:1788592734.866267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592734.866425:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136805120 00000100:00100000:2.0:1788592734.866440:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136805120 00000100:00100000:2.0:1788592734.866514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1788592734.866525:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+27:10309:x1875475136805120:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592734.867007:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:10309:x1875475136805120:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 481us (753us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788592734.867017:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592734.963190:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.963299:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136805376 00000100:00100000:3.0:1788592734.963313:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136805376 00000100:00100000:3.0:1788592734.963431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1788592734.963443:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:10319:x1875475136805376:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592734.963477:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592734.963507:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a27 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592734.963789:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788592734.964031:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510d9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a27 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.964049:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:3.0:1788592734.964052:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592734.964058:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a27 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.964075:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4600, rc 0) 00000100:00100000:3.0:1788592734.964197:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10319:x1875475136805376:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 756us (1021us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788592734.964205:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:1.0:1788592734.968923:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.969016:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136805504 00000100:00100000:3.0:1788592734.969031:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136805504 00000100:00100000:3.0:1788592734.969145:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1788592734.969157:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10319:x1875475136805504:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:3.0:1788592734.969262:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969285:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969301:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969322:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969345:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969459:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969580:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969590:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969596:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592734.969669:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969685:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969692:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969699:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969705:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592734.969710:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969718:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969740:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592734.969743:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592734.969749:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969765:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969780:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969786:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969792:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969989:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592734.969992:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.969999:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970008:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981898bfc00) 00010000:00010000:3.0:1788592734.970010:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592734.970013:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970019:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970047:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970054:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970059:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970064:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592734.970067:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970073:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970081:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592734.970084:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592734.970087:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592734.970093:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592734.970198:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10319:x1875475136805504:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1041us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592734.970207:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1788592734.973227:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592734.973326:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136805760 00000100:00100000:3.0:1788592734.973340:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136805760 00000100:00100000:3.0:1788592734.973441:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1788592734.973465:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10319:x1875475136805760:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592734.973787:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+30:10319:x1875475136805760:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 324us (575us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788592734.973796:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:1.0:1788592735.016040:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592735.016157:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806016 00000100:00100000:0.0:1788592735.016190:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806016 00000100:00100000:0.0:1788592735.016269:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1788592735.016280:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+30:10322:x1875475136806016:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592735.016311:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592735.016338:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a2e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016478:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016497:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016512:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016528:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016536:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016542:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016707:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016715:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016722:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592735.016741:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788592735.016892:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016901:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016907:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016913:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592735.016918:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016927:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016942:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592735.016945:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592735.016951:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016957:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510dc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016973:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016979:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.016996:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017002:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592735.017005:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017011:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017020:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2de00) 00010000:00010000:0.0:1788592735.017022:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592735.017026:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017031:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017086:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132510dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017101:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592735.017110:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:0.0:1788592735.017112:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592735.017115:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb400, rc 0) 00000100:00100000:0.0:1788592735.017207:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10322:x1875475136806016:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 928us (1182us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788592735.017224:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1788592735.021624:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592735.021710:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806144 00000100:00100000:2.0:1788592735.021724:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806144 00000100:00100000:3.0:1788592735.021902:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1788592735.021916:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10322:x1875475136806144:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1788592735.022012:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022032:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022046:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022080:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022087:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022095:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022102:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592735.022107:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022116:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022152:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592735.022155:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592735.022161:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.022169:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592735.022256:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10322:x1875475136806144:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 344us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592735.022263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1788592735.025726:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.026001:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806400 00000100:00100000:3.0:1788592735.026014:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806400 00000100:00100000:3.0:1788592735.026077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1788592735.026089:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10322:x1875475136806400:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592735.026422:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:10322:x1875475136806400:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 334us (710us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788592735.026431:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1788592735.207162:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592735.207218:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592735.207256:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592735.207337:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806528 00000100:00100000:2.0:1788592735.207368:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806528 00000100:00100000:2.0:1788592735.207445:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:2.0:1788592735.207456:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136806528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592735.207568:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136806528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 114us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592735.207576:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 290 00000100:00100000:0.0:1788592735.207844:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806784 00000100:00100000:0.0:1788592735.207850:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806784 00000100:00100000:0.0:1788592735.207903:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:0.0:1788592735.207911:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136806784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592735.207958:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136806784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 49us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592735.207965:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00080000:0.0:1788592735.207984:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592735.208433:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136806656 00000100:00100000:3.0:1788592735.208440:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136806656 00000100:00100000:3.0:1788592735.208486:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:3.0:1788592735.208495:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136806656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592735.208581:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136806656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 86us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592735.208589:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1788592735.275639:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.275822:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136807040 00000100:00100000:3.0:1788592735.275853:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136807040 00000100:00100000:3.0:1788592735.275925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:3.0:1788592735.275936:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+33:10353:x1875475136807040:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1788592735.275972:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592735.275998:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510dea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a35 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.276145:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.276162:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.276176:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592735.276188:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788592735.276428:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510dea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a35 expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.276450:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a35 expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.276461:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592735.276464:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592735.276470:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5600, rc 0) 00000100:00100000:3.0:1788592735.276546:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10353:x1875475136807040:12345-192.168.204.20@tcp:101:cat.0 Request processed in 611us (924us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788592735.276554:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:0.0:1788592735.282572:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.282761:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136807168 00000100:00100000:3.0:1788592735.282775:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136807168 00000100:00100000:3.0:1788592735.282856:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1788592735.282868:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:2344:x1875475136807168:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592735.283031:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592735.283067:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a35 expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.283089:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592735.283095:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592735.284948:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182bf2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:2344:x1875475136807168:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2067us (2374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592735.284963:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1788592735.289893:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.290204:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136807424 00000100:00100000:3.0:1788592735.290216:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136807424 00000100:00100000:3.0:1788592735.290288:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1788592735.290298:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:10353:x1875475136807424:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:3.0:1788592735.290712:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10353:x1875475136807424:12345-192.168.204.20@tcp:35:cat.0 Request processed in 414us (834us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788592735.290721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1788592735.351329:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592735.351477:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136807680 00000100:00100000:1.0:1788592735.351506:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136807680 00000100:00100000:1.0:1788592735.351573:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1788592735.351583:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10359:x1875475136807680:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1788592735.351625:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592735.351630:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788592735.351666:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510d57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a0b expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351690:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592735.351696:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592735.351713:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510dff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a3c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351834:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351850:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351859:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351895:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.351910:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 35 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592735.351924:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147323520:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592735.352021:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981932e50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592735.355500:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592735.355980:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147323520:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592735.356017:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592735.356113:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136807808 00000100:00100000:2.0:1788592735.356124:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136807808 00010000:00010000:2.0:1788592735.356176:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 36 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592735.356225:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:2.0:1788592735.356236:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+36:2344:x1875475136807808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592735.356255:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592735.356263:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 36 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356278:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 36 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356307:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510dd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a2e expref: 36 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356326:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:2.0:1788592735.356332:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356344:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356709:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.356757:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592735.356879:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+35:2344:x1875475136807808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 642us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592735.356888:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00010000:00010000:1.0:1788592735.356950:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.356960:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592735.356985:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788592735.357203:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510dff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 36 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.357227:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 35 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.357234:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592735.357238:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592735.357241:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfc00, rc 0) 00000100:00100000:1.0:1788592735.357272:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10359:x1875475136807680:12345-192.168.204.20@tcp:101:dd.0 Request processed in 5690us (5957us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788592735.357280:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1788592735.361241:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.361945:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808064 00000100:00100000:3.0:1788592735.361961:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808064 00000100:00100000:3.0:1788592735.362039:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:3.0:1788592735.362049:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10359:x1875475136808064:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:3.0:1788592735.362414:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.362459:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.362474:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592735.362535:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1788592735.362559:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a89c5b8 reply state 000000005c13052e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592735.362569:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592735.363588:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+38:10359:x1875475136808064:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1532us (2353us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788592735.363606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000020:00080000:3.0:1788592735.363613:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592735.376554:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376577:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376586:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376897:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592735.376904:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376914:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376939:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592735.376942:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592735.376948:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.376955:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.487577:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592735.575134:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.575231:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808192 00000100:00100000:3.0:1788592735.575246:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808192 00000100:00100000:3.0:1788592735.575392:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1788592735.575404:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+37:10373:x1875475136808192:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:3.0:1788592735.575441:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592735.575471:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a43 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575572:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575590:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575605:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575654:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575662:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575670:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575819:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575832:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575841:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575886:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 38 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.575902:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 38 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592735.575919:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147323648:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592735.576038:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819019a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592735.579692:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147323648:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592735.579734:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592735.579984:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.580405:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808448 00000100:00100000:3.0:1788592735.580414:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808448 00000100:00100000:3.0:1788592735.580477:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592735.580489:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+39:5582:x1875475136808448:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788592735.581235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+40:5582:x1875475136808448:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 744us (1248us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788592735.581246:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1788592735.584128:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.584238:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808576 00000100:00100000:3.0:1788592735.584252:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808576 00010000:00010000:3.0:1788592735.584303:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 40 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592735.584474:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:3.0:1788592735.584486:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+40:2343:x1875475136808576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592735.584504:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592735.584512:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 40 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584528:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 40 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584553:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132510e06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a3c expref: 40 pid: 5824 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584576:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592735.584607:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584618:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584638:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.584683:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592735.584762:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+39:2343:x1875475136808576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 279us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592735.584770:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00010000:00010000:1.0:1788592735.584839:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.584848:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592735.584902:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788592735.584906:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592735.584954:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.584967:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.584978:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.584994:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585001:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585008:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592735.585012:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585021:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585032:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592735.585034:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592735.585039:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585045:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132510e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585058:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585064:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585070:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585076:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592735.585086:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585093:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585101:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981898bfc00) 00010000:00010000:1.0:1788592735.585105:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592735.585108:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585114:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f132510e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585156:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a43 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585171:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a43 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.585179:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592735.585181:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592735.585184:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5600, rc 0) 00000100:00100000:1.0:1788592735.585214:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+38:10373:x1875475136808192:12345-192.168.204.20@tcp:101:stat.0 Request processed in 9812us (10096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592735.585222:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1788592735.646235:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592735.646337:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808832 00000100:00100000:2.0:1788592735.646773:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808832 00000100:00100000:2.0:1788592735.646851:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:2.0:1788592735.646862:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+38:10379:x1875475136808832:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:2.0:1788592735.646962:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592735.646995:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132510e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a43 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.647019:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:2.0:1788592735.647025:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592735.647291:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.647308:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592735.647321:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592735.648103:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788592735.648143:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fbbddd0 reply state 000000009d05e69e transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592735.648155:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592735.648380:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+40:10379:x1875475136808832:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 1515us (2159us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788592735.648389:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000020:00080000:2.0:1788592735.648395:0:6700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592735.655253:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655279:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655289:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655295:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592735.655301:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655311:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655335:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592735.655381:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592735.655390:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.655418:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510e37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592735.819509:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592735.819618:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136808960 00000100:00100000:1.0:1788592735.819641:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136808960 00000100:00100000:1.0:1788592735.819720:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1788592735.819733:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+39:10393:x1875475136808960:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:1.0:1788592735.819792:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592735.819822:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510e3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a4a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819908:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819925:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819943:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819961:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819969:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.819976:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820092:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820101:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820108:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592735.820151:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788592735.820162:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592735.820187:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820202:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820212:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820220:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820228:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820235:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592735.820240:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820249:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820263:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592735.820267:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592735.820272:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820280:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510e45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820298:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820316:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820323:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820328:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592735.820332:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820339:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820347:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89818289a400) 00010000:00010000:1.0:1788592735.820411:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592735.820414:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820421:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132510e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820462:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132510e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820478:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592735.820487:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592735.820489:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592735.820500:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf400, rc 0) 00000100:00100000:1.0:1788592735.820638:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+40:10393:x1875475136808960:12345-192.168.204.20@tcp:101:stat.0 Request processed in 906us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592735.820647:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1788592735.943599:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592735.943729:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136809216 00000100:00100000:3.0:1788592735.943754:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136809216 00000100:00100000:3.0:1788592735.943831:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1788592735.943844:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+40:10403:x1875475136809216:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592735.943875:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592735.943902:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a51 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592735.944055:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788592735.944216:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a51 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.944233:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:3.0:1788592735.944236:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592735.944244:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a51 expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592735.944261:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592735.944408:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+41:10403:x1875475136809216:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 508us (773us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788592735.944417:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:1.0:1788592735.948885:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592735.949027:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136809472 00000100:00100000:2.0:1788592735.949040:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136809472 00000100:00100000:2.0:1788592735.949109:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1788592735.949120:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+41:10403:x1875475136809472:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592735.949569:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+42:10403:x1875475136809472:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 449us (696us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788592735.949578:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:1.0:1788592736.010557:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592736.010788:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136809728 00000100:00100000:0.0:1788592736.010801:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136809728 00000100:00100000:0.0:1788592736.010901:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:0.0:1788592736.010913:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+42:10409:x1875475136809728:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592736.010948:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592736.010976:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510e68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a58 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.011141:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.011161:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.011172:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.011221:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.011238:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 43 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592736.011254:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147323776:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592736.011402:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905dbb40 going to sleep for 11 seconds 00000100:00080000:2.0:1788592736.011527:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592736.015937:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592736.016039:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136809856 00000100:00100000:2.0:1788592736.016051:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136809856 00010000:00010000:2.0:1788592736.016108:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 44 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592736.016159:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1788592736.016170:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+44:2344:x1875475136809856:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592736.016189:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592736.016198:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 44 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.016231:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 44 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.016259:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:2.0:1788592736.016266:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.016277:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.016285:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.016308:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592736.016415:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+44:2344:x1875475136809856:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 246us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592736.016423:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00010000:00010000:1.0:1788592736.017692:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132510e53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a4a expref: 43 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592736.017720:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147323776:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592736.017772:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.017783:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.017789:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592736.017817:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788592736.018032:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510e68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.018050:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.018060:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592736.018062:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592736.018066:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb200, rc 0) 00000100:00100000:1.0:1788592736.018170:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+43:10409:x1875475136809728:12345-192.168.204.20@tcp:101:bash.0 Request processed in 7259us (7628us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788592736.018179:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:0.0:1788592736.029025:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.029119:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136810112 00000100:00100000:3.0:1788592736.029132:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136810112 00000100:00100000:3.0:1788592736.029201:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1788592736.029228:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+43:10409:x1875475136810112:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1788592736.029611:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.029632:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.029646:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592736.029711:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788592736.029751:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074d98596 reply state 000000002d76a067 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592736.029761:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592736.030089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+46:10409:x1875475136810112:12345-192.168.204.20@tcp:36:bash.0 Request processed in 859us (1074us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788592736.030096:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000020:00080000:3.0:1788592736.030102:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592736.033025:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033049:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033059:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033065:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592736.033072:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033082:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033103:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592736.033106:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592736.033122:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.033130:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132510e7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592736.040112:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.040223:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136810240 00000100:00100000:3.0:1788592736.040235:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136810240 00000100:00100000:3.0:1788592736.040332:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:3.0:1788592736.040372:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+45:10409:x1875475136810240:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1788592736.040402:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592736.040431:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a5f expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.040530:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.040568:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 46 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.040577:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.040751:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 46 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.040768:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 46 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592736.040784:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147323904:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592736.040948:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819019ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592736.045180:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592736.045295:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136810368 00000100:00100000:0.0:1788592736.045308:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136810368 00010000:00010000:0.0:1788592736.045502:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 47 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592736.045595:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:0.0:1788592736.045606:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:2343:x1875475136810368:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592736.045652:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592736.045660:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 47 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.045676:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 47 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.045704:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:0.0:1788592736.045709:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.045720:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.045728:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.045768:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592736.045844:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:2343:x1875475136810368:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 239us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592736.045852:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00010000:00010000:3.0:1788592736.046451:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132510e6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a58 expref: 46 pid: 5824 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592736.046475:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147323904:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592736.046502:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.046514:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.046520:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592736.046596:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788592736.046613:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592736.046658:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.046701:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a5f expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.046720:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a5f expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.046729:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:3.0:1788592736.046732:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592736.046749:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592736.046813:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+45:10409:x1875475136810240:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6471us (6715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592736.046822:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1788592736.056582:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.056692:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136810624 00000100:00100000:3.0:1788592736.056705:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136810624 00000100:00100000:3.0:1788592736.056788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592736.056801:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+45:10409:x1875475136810624:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1788592736.057094:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+46:10409:x1875475136810624:12345-192.168.204.20@tcp:35:bash.0 Request processed in 295us (525us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788592736.057102:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:2.0:1788592736.183484:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592736.183580:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136810880 00000100:00100000:0.0:1788592736.183601:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136810880 00000100:00100000:0.0:1788592736.183674:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1788592736.183687:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+46:10419:x1875475136810880:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592736.183722:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592736.183762:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a66 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592736.183908:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788592736.184071:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510e92 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a66 expref: 48 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.184091:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592736.184095:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592736.184101:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132510e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a66 expref: 48 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.184117:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca200, rc 0) 00000100:00100000:0.0:1788592736.184193:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10419:x1875475136810880:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 510us (725us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788592736.184202:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1788592736.197913:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592736.198026:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136811008 00000100:00100000:1.0:1788592736.198041:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136811008 00000100:00100000:1.0:1788592736.198115:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1788592736.198127:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10419:x1875475136811008:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1788592736.198255:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198279:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198293:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198311:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198318:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198326:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198493:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198503:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198509:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592736.198560:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198573:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198589:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198596:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198601:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592736.198605:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198613:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198642:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592736.198645:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592736.198651:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198658:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132510ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198676:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198680:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198685:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198690:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592736.198698:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198703:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198709:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89818289a400) 00010000:00010000:1.0:1788592736.198711:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592736.198713:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198718:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198745:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198750:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198756:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198760:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592736.198762:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198769:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198777:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592736.198779:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592736.198788:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.198794:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510eae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592736.198898:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10419:x1875475136811008:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 771us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592736.198906:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:2.0:1788592736.201255:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.201399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136811264 00000100:00100000:3.0:1788592736.201413:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136811264 00000100:00100000:3.0:1788592736.201490:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:3.0:1788592736.201503:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10419:x1875475136811264:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592736.201857:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+48:10419:x1875475136811264:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 356us (615us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788592736.201884:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1788592736.248839:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592736.248952:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136811520 00000100:00100000:0.0:1788592736.248965:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136811520 00000100:00100000:0.0:1788592736.249034:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1788592736.249043:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+48:10422:x1875475136811520:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592736.249081:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592736.249108:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a6d expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249215:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249235:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249264:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249282:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249287:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249294:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249498:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249507:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249515:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592736.249525:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788592736.249669:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249678:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249685:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249691:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592736.249705:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249714:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249728:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592736.249745:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592736.249752:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249779:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132510ebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249796:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249803:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249810:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249816:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592736.249819:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249825:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249833:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2de00) 00010000:00010000:0.0:1788592736.249835:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592736.249844:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249851:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132510ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249899:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a6d expref: 51 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249911:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a6d expref: 50 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.249917:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:0.0:1788592736.249918:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592736.249921:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbe00, rc 0) 00000100:00100000:0.0:1788592736.250002:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10422:x1875475136811520:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 960us (1181us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788592736.250009:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:0.0:1788592736.254311:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592736.254504:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136811648 00000100:00100000:1.0:1788592736.254517:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136811648 00000100:00100000:1.0:1788592736.254592:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1788592736.254605:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10422:x1875475136811648:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592736.254709:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254743:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254765:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254807:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254815:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254823:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254830:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592736.254855:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254868:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254884:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592736.254887:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592736.254893:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.254900:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ed8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592736.254997:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10422:x1875475136811648:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 394us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592736.255005:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:2.0:1788592736.258887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.258992:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136811904 00000100:00100000:3.0:1788592736.259005:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136811904 00000100:00100000:3.0:1788592736.259069:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1788592736.259080:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10422:x1875475136811904:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592736.259405:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10422:x1875475136811904:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 325us (793us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788592736.259413:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:2.0:1788592736.268630:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592736.269002:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136812032 00000100:00100000:0.0:1788592736.269015:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136812032 00000100:00100000:0.0:1788592736.269099:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592736.269110:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+51:2342:x1875475136812032:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592736.269131:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592736.269164:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a6d expref: 51 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592736.269187:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:0.0:1788592736.269211:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592736.269279:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+50:2342:x1875475136812032:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 171us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592736.269289:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:3.0:1788592736.514247:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592736.557498:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592736.557611:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136812288 00000100:00100000:2.0:1788592736.557625:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136812288 00000100:00100000:2.0:1788592736.557702:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1788592736.557715:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10440:x1875475136812288:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1788592736.557778:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592736.557804:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a74 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.557923:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510ee6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.557940:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.557953:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510ee6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592736.557966:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788592736.558121:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a74 expref: 53 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.558144:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a74 expref: 52 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.558154:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:2.0:1788592736.558157:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788592736.558162:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5c00, rc 0) 00000100:00100000:2.0:1788592736.558237:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10440:x1875475136812288:12345-192.168.204.20@tcp:101:cat.0 Request processed in 526us (755us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788592736.558245:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1788592736.603806:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592736.604454:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136812416 00000100:00100000:1.0:1788592736.604470:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136812416 00000100:00100000:1.0:1788592736.604553:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:1.0:1788592736.604565:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10441:x1875475136812416:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592736.604607:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592736.604645:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a7b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604745:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604763:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604800:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592736.604841:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788592736.604845:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592736.604863:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604893:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132510ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a7b expref: 54 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604919:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a7b expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.604929:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592736.604932:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592736.604936:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bee00, rc 0) 00000100:00100000:1.0:1788592736.605015:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10441:x1875475136812416:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 452us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592736.605022:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1788592736.623816:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.623923:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136812800 00000100:00100000:3.0:1788592736.623937:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136812800 00000100:00100000:3.0:1788592736.624012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1788592736.624024:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10441:x1875475136812800:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592736.624522:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10441:x1875475136812800:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 498us (720us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788592736.624531:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1788592736.627005:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592736.629756:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136812928 00000100:00100000:1.0:1788592736.629839:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136812928 00000100:00100000:1.0:1788592736.629947:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1788592736.629959:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10441:x1875475136812928:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:1.0:1788592736.629978:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788592736.630014:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a5f expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.630068:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132510ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a74 expref: 53 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.630083:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a20 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592736.630096:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592736.630110:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592736.630189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10441:x1875475136812928:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 232us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592736.630197:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:0.0:1788592736.632293:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592736.632698:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813056 00000100:00100000:2.0:1788592736.632712:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813056 00000100:00100000:2.0:1788592736.632814:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1788592736.632825:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10441:x1875475136813056:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:2.0:1788592736.632963:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.632987:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592736.633002:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592736.633378:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592736.633601:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788592736.633670:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788592736.633806:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10441:x1875475136813056:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 980us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592736.633816:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:2.0:1788592736.650892:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.651016:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813184 00000100:00100000:3.0:1788592736.651032:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813184 00000100:00100000:3.0:1788592736.651142:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:3.0:1788592736.651155:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10443:x1875475136813184:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592736.651190:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592736.651223:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a82 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651318:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651392:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651408:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651448:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651457:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651464:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651578:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651587:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651595:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592736.651640:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788592736.651646:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592736.651670:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651684:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651711:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651718:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651738:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651745:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592736.651751:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651759:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651773:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592736.651777:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592736.651782:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651790:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651804:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651811:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651817:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651828:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592736.651831:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651837:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651845:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981898bf100) 00010000:00010000:3.0:1788592736.651848:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592736.651850:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651856:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651898:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651913:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592736.651921:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:3.0:1788592736.651923:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592736.651925:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592736.652019:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10443:x1875475136813184:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 865us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592736.652027:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000040:00080000:2.0:1788592736.960689:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592736.960704:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592736.960803:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788592736.960813:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788592736.960978:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147324032:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592736.961090:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bd14b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788592736.978912:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147324032:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788592736.980152:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.980238:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813312 00000100:00100000:3.0:1788592736.980264:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813312 00000100:00100000:3.0:1788592736.980376:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1788592736.980388:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813312:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788592736.980490:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813312:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592736.980498:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1788592736.995669:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592736.995826:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813440 00000100:00100000:3.0:1788592736.995840:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813440 00000100:00100000:3.0:1788592736.995913:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:3.0:1788592736.995926:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813440:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592736.995972:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592736.996206:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813440:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 281us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592736.996215:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1788592737.022218:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.022392:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813568 00000100:00100000:1.0:1788592737.022407:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813568 00000100:00100000:1.0:1788592737.022535:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:1.0:1788592737.022548:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813568:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788592737.022673:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022699:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022730:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022799:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022808:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022834:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022873:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022882:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022889:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592737.022936:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788592737.022942:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592737.022959:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022971:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022978:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022985:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.022992:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.022997:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023006:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023025:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:1.0:1788592737.023029:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.023034:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023041:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f132510f25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023060:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023066:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023072:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023077:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.023080:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023087:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023094:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff89818289a400) 00010000:00010000:1.0:1788592737.023096:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.023099:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023105:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023136:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023143:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023149:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023155:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.023158:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023166:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023174:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:1.0:1788592737.023177:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.023180:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.023186:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132510f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.023282:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813568:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 734us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.023291:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1788592737.031131:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.031685:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813824 00000100:00100000:3.0:1788592737.031700:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813824 00000100:00100000:3.0:1788592737.031792:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:3.0:1788592737.031805:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10454:x1875475136813824:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.031836:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.031867:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a89 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032010:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032031:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032069:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592737.032084:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788592737.032220:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032229:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032238:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032246:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.032250:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032259:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032290:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:3.0:1788592737.032294:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592737.032301:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.032309:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.038822:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a89 expref: 54 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.038898:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:3.0:1788592737.038902:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592737.038914:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a89 expref: 54 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.038939:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4a00, rc 0) 00000100:00100000:2.0:1788592737.039180:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136813824:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 7375us (8062us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1788592737.039203:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:3.0:1788592737.049688:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.052314:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136813952 00000100:00100000:1.0:1788592737.052336:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136813952 00000100:00100000:1.0:1788592737.052562:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:1.0:1788592737.052590:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136813952:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788592737.052641:0:5822:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788592737.052797:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136813952:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 210us (3124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.052805:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1788592737.075632:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.075755:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136814208 00000100:00100000:2.0:1788592737.075772:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136814208 00000100:00100000:2.0:1788592737.075865:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1788592737.075877:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136814208:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592737.075905:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592737.075910:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788592737.075944:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f132510efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a7b expref: 53 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.075974:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592737.075980:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592737.075998:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132510f4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a90 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592737.076793:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788592737.077055:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510f56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.077073:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.077086:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510f56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.077157:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132510f4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a90 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.077197:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510f56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a90 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.077204:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8981a1fe1500) 00010000:00010000:2.0:1788592737.077207:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592737.077210:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:2.0:1788592737.077299:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10454:x1875475136814208:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1424us (1676us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788592737.077308:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1788592737.083605:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.084462:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136814464 00000100:00100000:3.0:1788592737.084479:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136814464 00000100:00100000:3.0:1788592737.084559:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1788592737.084580:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10454:x1875475136814464:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.084670:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592737.084705:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132510f56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a90 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084740:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8981a1fe1500) 00010000:00010000:3.0:1788592737.084755:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592737.084786:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084803:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084814:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084860:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084868:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084875:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084956:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084964:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084970:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084975:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.084980:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084988:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.084996:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592737.085000:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592737.085003:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085010:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085027:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085032:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085038:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085043:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.085046:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085051:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085058:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xec0c96ab (ffff8981898bf100) 00010000:00010000:3.0:1788592737.085061:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592737.085063:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.085069:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xec0c96ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.085747:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136814464:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1166us (2153us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592737.085757:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1788592737.094832:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.095324:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136814592 00000100:00100000:0.0:1788592737.095339:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136814592 00000100:00100000:0.0:1788592737.095425:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:0.0:1788592737.095438:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10454:x1875475136814592:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592737.095468:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592737.095501:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a97 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095577:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095596:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095610:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095756:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132510f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095791:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 54 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.095801:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592737.095804:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592737.095808:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592737.095896:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10454:x1875475136814592:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 460us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592737.095904:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:1.0:1788592737.106099:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.106277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136814848 00000100:00100000:1.0:1788592737.106290:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136814848 00000100:00100000:1.0:1788592737.106375:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1788592737.106385:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10454:x1875475136814848:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592737.106501:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.106522:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.106536:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592737.107575:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788592737.107593:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311348242523ns, next at 312348238701ns, rc = 0 00000004:00010000:1.0:1788592737.107996:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093d950d1 reply state 00000000e80fe9e3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.108010:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592737.108317:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10454:x1875475136814848:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1927us (2230us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788592737.108327:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:0.0:1788592737.111904:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.112185:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136814976 00000100:00100000:3.0:1788592737.112198:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136814976 00000100:00100000:3.0:1788592737.112285:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:3.0:1788592737.112297:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10454:x1875475136814976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.112337:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.112389:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1a9e expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.112475:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 57 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.112494:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 57 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.112522:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.112526:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592737.112531:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5200, rc 0) 00000100:00100000:3.0:1788592737.112607:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10454:x1875475136814976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 313us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.112615:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00010000:00010000:1.0:1788592737.112826:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112838:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112847:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112854:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.112859:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112870:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112885:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:1.0:1788592737.112888:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788592737.112892:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.112899:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132510f80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.130110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.130182:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136815104 00000100:00100000:1.0:1788592737.130197:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136815104 00000100:00100000:1.0:1788592737.133316:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:1.0:1788592737.133333:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2340:x1875475136815104:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788592737.133394:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:1.0:1788592737.133439:0:6677:0:(genops.c:1385:class_connect()) connect: client 551ef727-4fdd-447b-98b8-d223b2dddab7, cookie 0x27b316f132510f8e 00002000:00100000:1.0:1788592737.133456:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 551ef727-4fdd-447b-98b8-d223b2dddab7/ffff8981bbb8f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592737.133502:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788592737.133829:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788592737.133871:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8981bbb8e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592737.133978:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2340:x1875475136815104:12345-192.168.204.20@tcp:8:lhsmtool_posix.0 Request processed in 646us (3885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.133992:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592737.136955:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.141228:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136815232 00000100:00100000:2.0:1788592737.141327:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136815232 00000100:00080000:2.0:1788592737.141475:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592737.141678:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1788592737.141693:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:0:x1875475136815232:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788592737.228618:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:0:x1875475136815232:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 86915us (91663us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788592737.228636:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000001:00080000:1.0:1788592737.228697:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1788592737.228721:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000100:00100000:3.0:1788592737.231576:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.231737:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136815488 00000100:00100000:2.0:1788592737.231752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136815488 00000100:00100000:2.0:1788592737.231818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1788592737.231830:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10454:x1875475136815488:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788592737.232139:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10454:x1875475136815488:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 310us (577us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788592737.232147:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592737.234578:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.234709:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136815744 00000100:00100000:2.0:1788592737.234732:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136815744 00000100:00100000:2.0:1788592737.234795:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1788592737.234806:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10454:x1875475136815744:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592737.234955:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10454:x1875475136815744:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 150us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.234982:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:2.0:1788592737.238099:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.238231:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136815872 00000100:00100000:3.0:1788592737.238246:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136815872 00000100:00100000:3.0:1788592737.238934:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1788592737.238948:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10454:x1875475136815872:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.238976:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.239025:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1aa5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239147:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239168:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239185:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592737.239240:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592737.239272:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239306:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510f95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aa5 expref: 59 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239337:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aa5 expref: 58 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.239386:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.239390:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592737.239395:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4400, rc 0) 00000100:00100000:3.0:1788592737.239478:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10454:x1875475136815872:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 534us (1395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.239486:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:2.0:1788592737.245050:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.245128:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816000 00000100:00100000:3.0:1788592737.245141:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816000 00000100:00100000:3.0:1788592737.245552:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1788592737.245577:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136816000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.245602:0:8688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.245629:0:8688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1aac expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592737.245664:0:8688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc260, blocks: 0x1 00010000:00010000:3.0:1788592737.245693:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1788592737.245699:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592737.245723:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 6 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.245749:0:8688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 6 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.245767:0:8688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592737.245837:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136816000:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 276us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.245845:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1788592737.255671:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.255727:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816256 00000100:00100000:2.0:1788592737.255741:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816256 00000100:00100000:2.0:1788592737.255807:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:2.0:1788592737.255818:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10454:x1875475136816256:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592737.255960:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10454:x1875475136816256:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 143us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.255968:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:2.0:1788592737.260312:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.260501:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816384 00000100:00100000:3.0:1788592737.260514:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816384 00000100:00100000:3.0:1788592737.260586:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1788592737.260597:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:10454:x1875475136816384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592737.260622:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.260648:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ab3 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.260727:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.260739:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592737.260744:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592737.260751:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.260797:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.260814:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 7 pid: 8688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.260832:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147324160:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592737.260943:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819019a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592737.268386:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.268427:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816512 00000100:00100000:2.0:1788592737.268438:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816512 00010000:00010000:2.0:1788592737.268490:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 8 pid: 8688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.268536:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:2.0:1788592737.268546:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136816512:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592737.268566:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592737.268595:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 8 pid: 8688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.268612:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 8 pid: 8688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.268661:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592737.268667:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592737.268679:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.268691:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.268753:0:11159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.268769:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11159:1875475147324288:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592737.268865:0:11159:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7f00 going to sleep for 11 seconds 00010000:00010000:2.0:1788592737.269617:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f132510fa3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aac expref: 8 pid: 8688 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.269639:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147324160:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592737.269673:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.269686:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5600, rc 0) 00000100:00100000:2.0:1788592737.269753:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:10454:x1875475136816384:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 9158us (9457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.269763:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1788592737.279154:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.283018:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816640 00000100:00100000:1.0:1788592737.283038:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816640 00002000:00100000:1.0:1788592737.283108:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8981bc5d0e00 x1875475136816640/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:13/0 lens 504/0 e 0 to 0 dl 1788592748 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592737.283121:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc5d0e00 with x1875475136816640 ext(0->8) 00002000:00010000:1.0:1788592737.283129:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bc5d0e00 00000100:00100000:1.0:1788592737.283163:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1788592737.283173:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136816640:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788592737.284066:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136816640:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 889us (4922us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788592737.284077:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00002000:00100000:1.0:1788592737.284092:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8981bc5d0e00 x1875475136816640/t4294967302(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:13/0 lens 504/448 e 0 to 0 dl 1788592748 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592737.284102:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc5d0e00 with x1875475136816640 ext(0->8) 00002000:00010000:1.0:1788592737.284107:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bc5d0e00 00000100:00100000:0.0:1788592737.291751:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11159:1875475147324288:192.168.204.20@tcp:105: 00010000:00010000:0.0:1788592737.291788:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592737.293225:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136816512:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 24665us (24838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.293242:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1788592737.296323:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.296517:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816768 00000100:00100000:3.0:1788592737.296529:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816768 00000100:00100000:3.0:1788592737.296601:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:3.0:1788592737.296613:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10454:x1875475136816768:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788592737.404333:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10454:x1875475136816768:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 107694us (108007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.404379:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000001:00080000:3.0:1788592737.404438:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000001:00080000:3.0:1788592737.404478:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788592737.404484:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788592737.404503:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788592737.404525:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788592737.404542:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff898185a1a300 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788592737.404547:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc5a5a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff898185a1a240 00000020:00080000:3.0:1788592737.404550:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc5a5900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc932800 00000020:00080000:3.0:1788592737.404831:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788592737.404968:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788592737.404990:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147324416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788592737.405074:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.405161:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147324416 00000100:00100000:3.0:1788592737.405171:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147324416 00000100:00100000:3.0:1788592737.405229:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592737.405239:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147324416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788592737.405424:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788592737.405428:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788592736 00002000:00010000:3.0:1788592737.405430:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788592737.405432:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788592736 -> 1788592736 00002000:00010000:3.0:1788592737.405435:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788592737.405471:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3284:x1875475147324416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (396us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788592737.405477:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788592737.405496:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788592737.405534:0:3284:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff898183e99880/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788592737.405540:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147324416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788592737.406224:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147324544:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788592737.406274:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.406439:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147324544 00000100:00100000:2.0:1788592737.406447:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147324544 00000100:00100000:2.0:1788592737.406511:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592737.406521:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147324544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788592737.406555:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788592737.406594:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9bc25d, atime: 0x6a9bc25d, ctime: 0x6a9bc25d, blocks: 0x1 00010000:00010000:2.0:1788592737.406604:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.406626:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1788592737.406632:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592737.406641:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.406662:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.406672:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.406680:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.406730:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788592737.407386:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3285:x1875475147324544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 830us (1073us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788592737.407396:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788592737.407429:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592737.407437:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.407446:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592737.407452:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.407464:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.407485:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.407493:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132510fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.407515:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592737.407517:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592737.407518:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788592737.407896:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff898183e99500/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788592737.407905:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147324544:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788592737.408043:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592737.410784:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.410871:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136816896 00000100:00100000:3.0:1788592737.410884:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136816896 00000100:00100000:3.0:1788592737.410965:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1788592737.410976:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2342:x1875475136816896:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788592737.453077:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2342:x1875475136816896:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 42091us (42298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.453093:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000001:00080000:1.0:1788592737.456390:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788592737.456440:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788592737.465171:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.467909:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817152 00000100:00100000:3.0:1788592737.467928:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817152 00000100:00100000:0.0:1788592737.469782:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:0.0:1788592737.469800:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10454:x1875475136817152:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592737.469884:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592737.469926:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132510f9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aa5 expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.469950:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592737.469956:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592737.469999:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.470030:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.470042:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592737.470736:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2c09e0b reply state 000000009e9d8303 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.470753:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592737.470952:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10454:x1875475136817152:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1153us (5798us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788592737.470963:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1788592737.478415:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.478943:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817280 00000100:00100000:0.0:1788592737.478957:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817280 00000100:00100000:0.0:1788592737.479032:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:0.0:1788592737.479043:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136817280:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592737.479400:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788592737.479405:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788592736 -> 1788592735 00002000:00010000:0.0:1788592737.479408:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788592733 00002000:00010000:0.0:1788592737.479410:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788592736 -> 1788592735 00002000:00010000:0.0:1788592737.479413:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788592737.479491:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136817280:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 449us (1089us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788592737.479499:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00010000:00010000:3.0:1788592737.482682:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482701:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482723:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482731:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.482737:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482746:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482769:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.482773:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592737.482780:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.482788:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.485953:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.486053:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817536 00000100:00100000:2.0:1788592737.486083:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817536 00000100:00100000:2.0:1788592737.486158:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1788592737.486170:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10454:x1875475136817536:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788592737.486287:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.486318:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.486331:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.486407:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.486424:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 13 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.486439:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147324672:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592737.486551:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592737.495950:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.497008:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817664 00000100:00100000:0.0:1788592737.497029:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817664 00010000:00010000:0.0:1788592737.497095:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.497177:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1788592737.497188:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:2343:x1875475136817664:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592737.497299:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592737.497318:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.497335:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.497448:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147324672:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592737.497527:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a97 expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.498491:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.499080:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592737.499090:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.499106:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.499117:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.499156:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592737.499283:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499291:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499344:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499372:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499380:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499388:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.499392:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499402:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499414:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.499417:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788592737.499421:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.499446:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132510fbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.499539:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10454:x1875475136817536:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 13366us (13601us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788592737.499550:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:0.0:1788592737.499781:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2343:x1875475136817664:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2594us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592737.499789:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:1.0:1788592737.510476:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.510740:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817792 00000100:00100000:0.0:1788592737.510756:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817792 00000100:00100000:0.0:1788592737.510836:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1788592737.510848:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136817792:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788592737.510913:0:8688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.510941:0:8688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.510952:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592737.510958:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592737.510964:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.511013:0:8688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.511030:0:8688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.511048:0:8688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8688:1875475147324800:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592737.511146:0:8688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592737.516852:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.516900:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136817920 00000100:00100000:1.0:1788592737.516911:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136817920 00010000:00010000:1.0:1788592737.516966:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.517014:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1788592737.517025:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136817920:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592737.517046:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592737.517078:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517097:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 8 pid: 6676 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517149:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592737.517155:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592737.517163:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517176:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517216:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592737.517284:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136817920:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 259us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.517292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00010000:00010000:1.0:1788592737.517395:0:8688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060452712/0x27b316f132510faa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ab3 expref: 7 pid: 6676 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.517413:0:8688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8688:1875475147324800:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592737.517443:0:8688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517453:0:8688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517460:0:8688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517501:0:8688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517510:0:8688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517518:0:8688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517524:0:8688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592737.517528:0:8688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517538:0:8688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.517550:0:8688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.523124:0:8688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067d53827/0x27b316f132510fc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.523275:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136817792:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 12421us (12809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.523288:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:0.0:1788592737.530469:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.530514:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136818176 00000100:00100000:0.0:1788592737.530526:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136818176 00000100:00100000:0.0:1788592737.530597:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:0.0:1788592737.530616:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+12:10454:x1875475136818176:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592737.530728:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.530751:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.530766:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.531078:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.531090:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.531100:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.531142:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 13 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.531160:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 13 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.531176:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc853800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147324928:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592737.531858:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905dbe40 going to sleep for 11 seconds 00010000:00010000:0.0:1788592737.537721:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592737.541120:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc853800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147324928:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592737.541186:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.542404:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.542935:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136818304 00000100:00100000:3.0:1788592737.542948:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136818304 00010000:00010000:3.0:1788592737.543002:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.543055:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1788592737.543065:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+14:2344:x1875475136818304:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592737.543084:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592737.543091:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543107:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543134:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a9e expref: 14 pid: 6700 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543153:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.543159:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543202:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543212:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543246:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592737.543320:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2344:x1875475136818304:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 257us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.543328:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00010000:00010000:3.0:1788592737.543376:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.543383:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592737.543615:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788592737.543802:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788592737.543850:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788592737.543942:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147325056:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788592737.544002:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592737.544039:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592737.544070:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147325056 00000100:00100000:3.0:1788592737.544076:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147325056 00000100:00100000:3.0:1788592737.544112:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592737.544119:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875475147325056:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788592737.544196:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0515180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875475147325056:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.544203:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592737.544255:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788592737.544261:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff898183e99880, transno 4294967303 00000100:00100000:3.0:1788592737.544276:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147325056:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788592737.552532:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788592737.553217:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147325184:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788592737.553320:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592737.553392:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592737.554595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147325184 00000100:00100000:3.0:1788592737.554610:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147325184 00000100:00100000:3.0:1788592737.554676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592737.554688:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1875475147325184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788592737.555015:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1875475147325184:12345-0@lo:1000:mdt00_002.0 Request processed in 329us (1694us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788592737.555022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592737.555087:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147325184:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788592737.555138:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555150:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555158:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555165:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.555170:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555179:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555208:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592737.555211:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592737.555232:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555240:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132510fd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555280:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555286:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555292:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555297:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592737.555300:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555307:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555315:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:3.0:1788592737.555318:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592737.555321:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555327:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132510f02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555401:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555417:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555434:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555474:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.555492:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 16 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.555506:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147325312:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592737.555677:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592737.561749:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.561995:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981a0517800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147325312:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592737.562034:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.562238:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136818432 00000100:00100000:2.0:1788592737.562248:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136818432 00010000:00010000:2.0:1788592737.562716:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 17 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.562833:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1788592737.562850:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+17:2343:x1875475136818432:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592737.562871:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592737.562879:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 17 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.562894:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 17 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.562926:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1a82 expref: 17 pid: 5822 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.562960:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:3.0:1788592737.562967:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.562982:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.562992:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.563027:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592737.563103:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:2343:x1875475136818432:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 259us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.563112:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00010000:00010000:2.0:1788592737.563201:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563210:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563226:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563234:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563241:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563247:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592737.563252:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563260:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563271:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:2.0:1788592737.563274:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592737.563279:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563285:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f132510fdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563695:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563703:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563720:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563726:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592737.563729:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563736:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563747:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981a1fe1c00) 00010000:00010000:2.0:1788592737.563750:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592737.563754:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.563761:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132510fcd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.565363:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10454:x1875475136818176:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 34719us (34886us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1788592737.565379:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000020:00080000:2.0:1788592737.565386:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788592737.565868:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592737.565876:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592737.565911:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788592737.565919:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788592737.569963:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.570188:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136818688 00000100:00100000:3.0:1788592737.570213:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136818688 00000100:00100000:3.0:1788592737.570279:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592737.570291:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10454:x1875475136818688:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788592737.571192:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788592737.571328:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788592737.571413:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571435:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571451:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571474:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571482:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571489:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.571517:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592737.571647:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+17:10454:x1875475136818688:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1355us (1696us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788592737.571657:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000020:00080000:3.0:1788592737.571663:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592737.571785:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592737.571794:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.571802:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592737.571807:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.571816:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.571832:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8981898bfd00) 00010000:00010000:1.0:1788592737.571835:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788592737.571842:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.571848:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132510fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.571868:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592737.571870:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592737.571871:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592737.679766:0:11986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592737.679786:0:11986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592737.679840:0:11986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788592737.679848:0:11986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592737.859572:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.859661:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136818944 00000100:00100000:3.0:1788592737.859674:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136818944 00000100:00100000:3.0:1788592737.859805:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:3.0:1788592737.859818:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+17:10464:x1875475136818944:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592737.859856:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592737.859884:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510fe9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1aba expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.860015:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510ff0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.860033:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.860050:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592737.860070:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788592737.860223:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132510fe9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aba expref: 20 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.860243:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aba expref: 19 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.860253:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592737.860256:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592737.860261:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4000, rc 0) 00000100:00100000:3.0:1788592737.860347:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10464:x1875475136818944:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 531us (790us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788592737.860383:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:1.0:1788592737.863656:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.863769:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136819072 00000100:00100000:0.0:1788592737.863782:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136819072 00000100:00100000:0.0:1788592737.863879:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1788592737.863892:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10464:x1875475136819072:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:0.0:1788592737.863992:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.864015:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.864031:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.864049:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.864056:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.864063:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.864966:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.864980:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.864990:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592737.865054:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865070:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865077:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865085:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865091:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccba00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.865096:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865105:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865121:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592737.865125:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.865130:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865138:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132510ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865149:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865155:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865344:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865382:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.865386:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865392:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865402:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d500) 00010000:00010000:1.0:1788592737.865404:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.865408:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865414:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865432:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865439:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865445:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865451:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.865454:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865591:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865601:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89818289ae00) 00010000:00010000:1.0:1788592737.865604:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.865607:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.865613:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251100c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.865804:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10464:x1875475136819072:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1909us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.865815:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1788592737.911600:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.911673:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136819328 00000100:00100000:0.0:1788592737.911687:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136819328 00000100:00100000:0.0:1788592737.911764:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:0.0:1788592737.911775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10467:x1875475136819328:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592737.911804:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592737.911834:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ac1 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.911940:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.911960:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.911976:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.911995:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.912003:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.912011:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.913301:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.913320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.913344:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592737.913382:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788592737.914265:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914279:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914286:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914292:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592737.914296:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914305:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914324:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592737.914327:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592737.914333:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914339:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f13251101a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914373:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914380:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914394:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914400:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592737.914403:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914409:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914417:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d100) 00010000:00010000:0.0:1788592737.914419:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592737.914423:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914429:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511021 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914711:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 22 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914731:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.914739:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:0.0:1788592737.914741:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592737.914744:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca200, rc 0) 00000100:00100000:0.0:1788592737.914841:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10467:x1875475136819328:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3067us (3256us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788592737.914861:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:0.0:1788592737.922914:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.923091:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136819456 00000100:00100000:1.0:1788592737.923105:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136819456 00000100:00100000:1.0:1788592737.923175:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:1.0:1788592737.923188:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10467:x1875475136819456:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592737.923288:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923311:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923325:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923458:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923484:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923491:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923497:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.923502:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923510:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923524:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:1.0:1788592737.923528:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592737.923533:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.923540:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.923716:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10467:x1875475136819456:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 513us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592737.923725:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:1.0:1788592737.928007:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.928111:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136819712 00000100:00100000:3.0:1788592737.928232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136819712 00000100:00100000:3.0:1788592737.928341:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1788592737.928380:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10467:x1875475136819712:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592737.928757:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:10467:x1875475136819712:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 381us (764us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788592737.928767:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:0.0:1788592737.950279:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592737.951032:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136819968 00000100:00100000:1.0:1788592737.951049:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136819968 00000100:00100000:2.0:1788592737.951252:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:2.0:1788592737.951266:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:9996:x1875475136819968:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592737.951305:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592737.951335:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251103d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ac8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.951502:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.951520:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.951532:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.951581:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.951597:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 23 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592737.951612:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147325440:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592737.952120:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592737.954891:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147325440:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592737.954938:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.955073:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592737.956438:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820096 00000100:00100000:3.0:1788592737.956540:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820096 00010000:00010000:3.0:1788592737.956717:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 24 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592737.956800:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1788592737.956832:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:2344:x1875475136820096:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592737.956852:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592737.956860:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 24 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956875:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 24 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956904:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac1 expref: 24 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956925:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:3.0:1788592737.956931:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956943:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956951:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592737.956995:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592737.957087:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:2344:x1875475136820096:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 259us (2016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592737.957095:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00010000:00010000:2.0:1788592737.957205:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.957215:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592737.957240:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788592737.957501:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251103d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.957521:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.957529:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:2.0:1788592737.957532:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788592737.957535:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5400, rc 0) 00000100:00100000:2.0:1788592737.957577:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:9996:x1875475136819968:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6314us (7316us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788592737.957585:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:1.0:1788592737.960912:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.960988:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820352 00000100:00100000:0.0:1788592737.961003:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820352 00000100:00100000:0.0:1788592737.961211:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:0.0:1788592737.961223:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+23:9996:x1875475136820352:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:0.0:1788592737.962241:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.962270:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.962287:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592737.962656:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788592737.962696:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003608e73 reply state 00000000b0b0a2b3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592737.962717:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788592737.962957:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788592737.963209:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+27:9996:x1875475136820352:12345-192.168.204.20@tcp:36:bash.0 Request processed in 1983us (2310us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788592737.963237:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000020:00080000:1.0:1788592737.963244:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788592737.967089:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967116:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967125:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967133:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592737.967140:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967149:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967171:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:1.0:1788592737.967174:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592737.967181:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592737.967189:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592737.971079:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.971270:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820480 00000100:00100000:0.0:1788592737.971282:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820480 00000100:00100000:0.0:1788592737.971389:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1788592737.971402:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:9996:x1875475136820480:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592737.971437:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592737.971732:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1acf expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.971852:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1acf expref: 27 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.971874:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511059 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1acf expref: 27 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592737.971899:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:0.0:1788592737.971903:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592737.971908:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592737.972011:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+27:9996:x1875475136820480:12345-192.168.204.20@tcp:101:bash.0 Request processed in 611us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592737.972018:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1788592737.976105:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592737.976612:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820608 00000100:00100000:2.0:1788592737.976626:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820608 00000100:00100000:2.0:1788592737.976745:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1788592737.976759:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:9996:x1875475136820608:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592737.976784:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592737.976815:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ad6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592737.976875:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bc25f, atime: 0x6a9bc25d, ctime: 0x6a9bc25f, blocks: 0xb 00010000:00010000:2.0:1788592737.976907:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1788592737.976912:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592737.976923:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.976948:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592737.976964:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592737.977056:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:9996:x1875475136820608:12345-192.168.204.20@tcp:101:bash.0 Request processed in 300us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592737.977065:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:1.0:1788592737.988855:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592737.989233:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820736 00000100:00100000:0.0:1788592737.989315:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820736 00002000:00010000:0.0:1788592737.989399:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788592737.989406:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaadc00 with x1875475136820736 ext(0->18446744073709551615) 00002000:00010000:0.0:1788592737.989422:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaadc00. 00000100:00100000:0.0:1788592737.989504:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1788592737.989520:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136820736:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:0.0:1788592737.989925:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788592737.989930:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788592735 -> 1788592737 00002000:00010000:0.0:1788592737.989938:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788592733 -> 1788592733 00002000:00010000:0.0:1788592737.989941:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788592735 -> 1788592737 00002000:00010000:0.0:1788592737.989943:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788592737.990068:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136820736:12345-192.168.204.20@tcp:10:bash.0 Request processed in 552us (1230us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788592737.990076:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00010000:0.0:1788592737.990081:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788592737.990084:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaadc00 with x1875475136820736 ext(0->18446744073709551615) 00002000:00010000:0.0:1788592737.990089:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaadc00. 00000100:00100000:3.0:1788592738.088521:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.088615:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136820864 00000100:00100000:1.0:1788592738.088630:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136820864 00000100:00100000:1.0:1788592738.088754:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:1.0:1788592738.088787:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+27:10481:x1875475136820864:12345-192.168.204.20@tcp:34:lfs.0 00000100:00080000:3.0:1788592738.089048:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592738.089135:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089160:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089176:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089197:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089204:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089210:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089643:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089653:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.089662:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592738.090809:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090833:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090856:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090865:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090871:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592738.090877:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090957:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090977:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592738.090980:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592738.090987:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.090995:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511067 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091029:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091036:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091041:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091047:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592738.091129:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091137:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091147:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89818289ae00) 00010000:00010000:1.0:1788592738.091150:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592738.091154:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091160:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251106e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091183:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091189:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091196:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091201:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592738.091204:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.091211:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.092781:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:1.0:1788592738.092792:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592738.092819:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.092830:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f132511075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.092994:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0517800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+27:10481:x1875475136820864:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 4203us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.093007:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:2.0:1788592738.141878:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592738.143040:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136821120 00000100:00100000:0.0:1788592738.143057:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136821120 00000100:00100000:0.0:1788592738.143142:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:0.0:1788592738.143155:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+27:10484:x1875475136821120:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592738.143184:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592738.143212:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251107c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1add expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143313:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143331:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143345:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143395:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143404:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143411:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143772:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143783:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.143791:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592738.143803:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788592738.145056:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145071:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145079:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145085:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592738.145090:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145099:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145117:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592738.145120:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592738.145126:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145152:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145168:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145173:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145178:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145184:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592738.145187:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145192:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145199:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d100) 00010000:00010000:0.0:1788592738.145202:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592738.145204:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145209:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f13251108a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145274:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251107c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1add expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145290:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1add expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.145305:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:0.0:1788592738.145308:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788592738.145310:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb600, rc 0) 00000100:00100000:0.0:1788592738.145538:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10484:x1875475136821120:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 2384us (3677us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788592738.145548:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 92 00000100:00100000:2.0:1788592738.155723:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.155871:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136821248 00000100:00100000:1.0:1788592738.155885:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136821248 00000100:00100000:1.0:1788592738.155967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:1.0:1788592738.155979:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10484:x1875475136821248:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592738.156070:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.156094:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.156106:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.156153:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.156168:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 29 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.156183:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147325568:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592738.156406:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff898086a7a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592738.164308:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaac000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147325568:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592738.164394:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.164677:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.164745:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136821504 00000100:00100000:2.0:1788592738.164755:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136821504 00000100:00100000:2.0:1788592738.164815:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:2.0:1788592738.164826:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+30:5582:x1875475136821504:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788592738.165277:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:5582:x1875475136821504:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 450us (1101us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788592738.165303:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1788592738.174931:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592738.177251:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136821632 00000100:00100000:3.0:1788592738.177272:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136821632 00010000:00010000:2.0:1788592738.177519:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 31 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.177616:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:2.0:1788592738.177642:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+31:2343:x1875475136821632:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592738.177662:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592738.177670:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 31 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177686:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 31 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177727:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511044 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ac8 expref: 31 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177749:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:2.0:1788592738.177755:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177767:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177776:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.177821:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592738.177913:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+30:2343:x1875475136821632:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 274us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592738.177929:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00010000:00010000:1.0:1788592738.178274:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178284:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178328:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178336:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178344:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178372:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592738.178377:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178386:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178398:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:1.0:1788592738.178401:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592738.178404:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.178411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251109f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.178500:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10484:x1875475136821248:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 22522us (22794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.178509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:0.0:1788592738.183369:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592738.186496:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136821888 00000100:00100000:3.0:1788592738.186521:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136821888 00000100:00100000:3.0:1788592738.186601:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1788592738.186613:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:10484:x1875475136821888:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592738.186980:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+30:10484:x1875475136821888:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 368us (3822us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788592738.186989:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:0.0:1788592738.303860:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592738.304303:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136822144 00000100:00100000:3.0:1788592738.304319:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136822144 00000100:00100000:3.0:1788592738.304436:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:3.0:1788592738.304448:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+30:10495:x1875475136822144:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1788592738.304483:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592738.304513:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325110a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ae4 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304611:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304630:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304646:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304663:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304670:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.304710:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.305090:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325110bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.305102:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325110bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.305110:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325110bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592738.305122:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788592738.315859:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315884:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315893:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315900:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.315906:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315916:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315941:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592738.315944:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.315951:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315958:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f1325110ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315981:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315988:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.315994:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.316995:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.317001:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317011:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317026:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981898bf400) 00010000:00010000:2.0:1788592738.317029:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.317034:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317041:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325110b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317129:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325110a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ae4 expref: 33 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317148:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325110bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ae4 expref: 32 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.317156:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:2.0:1788592738.317159:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592738.317162:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5200, rc 0) 00000100:00100000:2.0:1788592738.317269:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10495:x1875475136822144:12345-192.168.204.20@tcp:101:cat.0 Request processed in 12822us (13423us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788592738.317579:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1788592738.322904:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.324811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136822400 00000100:00100000:1.0:1788592738.324832:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136822400 00000100:00100000:1.0:1788592738.324910:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:1.0:1788592738.324923:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10495:x1875475136822400:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:1.0:1788592738.325267:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:10495:x1875475136822400:12345-192.168.204.20@tcp:35:cat.0 Request processed in 345us (2379us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788592738.325287:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592738.369611:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.369770:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136822656 00000100:00100000:2.0:1788592738.369798:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136822656 00000100:00100000:2.0:1788592738.369881:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:2.0:1788592738.369895:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+33:10497:x1875475136822656:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1788592738.369987:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788592738.370028:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325110bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ae4 expref: 33 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370060:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1add expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370076:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1acf expref: 31 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370088:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff898185c2dc00) 00010000:00010000:2.0:1788592738.370102:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592738.370131:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370150:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370182:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370202:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370209:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.370217:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.373436:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.373464:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.373479:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592738.376098:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788592738.376122:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312616771984ns, next at 313616764929ns, rc = 0 00010000:00010000:3.0:1788592738.378296:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.378331:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.378366:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379688:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379707:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379713:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379827:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592738.379864:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379871:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379878:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379884:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592738.379890:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379899:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379918:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfc00) 00010000:00010000:3.0:1788592738.379922:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788592738.379929:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379952:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325110d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379982:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379989:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.379996:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.380001:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592738.380005:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.380011:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.380021:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592738.380023:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592738.380026:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.380032:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325110c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592738.380045:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000033d41ff reply state 00000000b6e16e80 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592738.380058:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592738.380238:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0516d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+32:10497:x1875475136822656:12345-192.168.204.20@tcp:36:rm.0 Request processed in 10338us (10637us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788592738.380249:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00010000:00010000:2.0:1788592738.384026:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.384057:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.384066:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.384072:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.384077:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.384086:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.384110:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981a1fe1400) 00010000:00010000:2.0:1788592738.384123:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.384129:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384136:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592738.384137:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325110d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384146:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384151:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592738.384155:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384162:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384172:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8981898bfc00) 00010000:00010000:0.0:1788592738.384175:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592738.384179:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384185:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f1325110de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.384225:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592738.384227:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592738.384228:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592738.459790:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592738.460039:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136822912 00000100:00100000:0.0:1788592738.460053:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136822912 00000100:00100000:0.0:1788592738.460143:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:0.0:1788592738.460164:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981a0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:10503:x1875475136822912:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592738.460200:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592738.460229:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325110e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1aeb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460442:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460461:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460476:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460493:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460500:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.460507:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592738.461226:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788592738.461485:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461499:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461509:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461550:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461558:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461564:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461570:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592738.461575:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461583:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461597:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592738.461600:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592738.461606:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325110ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592738.461642:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca004afa reply state 0000000080b10902 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592738.461655:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592738.461712:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325110e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461730:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.461738:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592738.461741:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592738.461744:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb400, rc 0) 00000100:00100000:0.0:1788592738.461858:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981a0514380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+34:10503:x1875475136822912:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1703us (2082us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788592738.461869:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00010000:00010000:3.0:1788592738.471317:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471344:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471410:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471417:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592738.471423:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471432:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471455:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d100) 00010000:00010000:3.0:1788592738.471459:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592738.471466:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.471474:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f1325110f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592738.472733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.475998:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823040 00000100:00100000:1.0:1788592738.476022:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823040 00000100:00100000:1.0:1788592738.476152:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1788592738.476172:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136823040:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592738.476197:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592738.476226:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1af2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592738.476265:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00080000:0.0:1788592738.476401:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788592738.477636:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=312s v=(0 0) 00010000:00010000:1.0:1788592738.477646:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592738.477664:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.477702:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.477740:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf400, rc 0) 00000100:00100000:1.0:1788592738.477881:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136823040:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1709us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.477892:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1788592738.488552:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.488751:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823168 00000100:00100000:2.0:1788592738.488765:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823168 00000100:00100000:2.0:1788592738.488967:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:2.0:1788592738.488980:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:10503:x1875475136823168:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592738.489006:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592738.489048:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1af9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.489091:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.489102:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592738.489107:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592738.489114:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.489178:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 9 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.489196:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 9 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.489212:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147325696:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592738.489333:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592738.494890:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147325696:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592738.494896:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1788592738.494942:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.494972:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:1.0:1788592738.495035:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823296 00000100:00100000:1.0:1788592738.495044:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823296 00010000:00010000:1.0:1788592738.495089:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 10 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.495193:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+10:10503:x1875475136823168:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6215us (6655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592738.495224:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:1.0:1788592738.496607:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1788592738.496639:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2343:x1875475136823296:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592738.496669:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592738.496721:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 10 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.496742:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 10 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.496850:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bc8a3cb/0x27b316f132511108 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af2 expref: 10 pid: 6678 timeout: 412 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.496870:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592738.496875:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592738.496903:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.496915:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.496965:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.496982:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaaca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147325824:192.168.204.20@tcp:105: 00000100:00100000:1.0:1788592738.497084:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff898086a7a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592738.502050:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaaca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147325824:192.168.204.20@tcp:105: 00010000:00010000:1.0:1788592738.502091:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592738.502655:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136823296:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 6033us (7758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.502669:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1788592738.505766:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.505962:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823552 00000100:00100000:1.0:1788592738.505976:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823552 00000100:00100000:1.0:1788592738.506080:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:1.0:1788592738.506093:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:10503:x1875475136823552:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1788592738.507174:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:10503:x1875475136823552:12345-192.168.204.20@tcp:35:bash.0 Request processed in 1076us (1498us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788592738.507187:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00010000:00010000:1.0:1788592738.558755:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592738.698110:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.698334:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823680 00000100:00100000:1.0:1788592738.698383:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823680 00000100:00100000:1.0:1788592738.698463:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:1.0:1788592738.698475:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:10519:x1875475136823680:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592738.698516:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592738.698544:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b00 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698635:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698665:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698694:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592738.698739:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788592738.698742:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592738.698764:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698793:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b00 expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698818:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b00 expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.698827:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592738.698829:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592738.698834:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfa00, rc 0) 00000100:00100000:1.0:1788592738.698916:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10519:x1875475136823680:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 442us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.698931:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:0.0:1788592738.709761:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.709937:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136823936 00000100:00100000:2.0:1788592738.709950:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136823936 00000100:00100000:2.0:1788592738.710023:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:2.0:1788592738.710035:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+35:10519:x1875475136823936:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592738.710063:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592738.710090:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511124 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b07 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.710232:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251112b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.710250:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251112b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.710264:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251112b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592738.710275:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788592738.710485:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511124 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b07 expref: 38 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.710509:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251112b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b07 expref: 37 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.710519:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592738.710522:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592738.710526:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5400, rc 0) 00000100:00100000:2.0:1788592738.710625:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+37:10519:x1875475136823936:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 592us (881us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788592738.710633:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:2.0:1788592738.716641:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.716811:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824064 00000100:00100000:1.0:1788592738.716825:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824064 00000100:00100000:1.0:1788592738.716915:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592738.716929:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+37:2343:x1875475136824064:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592738.716950:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592738.716983:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251112b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b07 expref: 37 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.717010:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:1.0:1788592738.717018:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592738.717096:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+36:2343:x1875475136824064:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.717104:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:3.0:1788592738.729317:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.729747:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824320 00000100:00100000:1.0:1788592738.729763:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824320 00000100:00100000:1.0:1788592738.729858:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:1.0:1788592738.729873:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+36:10519:x1875475136824320:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592738.729905:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592738.729934:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b0e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.730072:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.730090:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.730121:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592738.730140:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788592738.730300:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b0e expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.730325:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b0e expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.730334:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:1.0:1788592738.730338:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788592738.730342:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bea00, rc 0) 00000100:00100000:1.0:1788592738.730458:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+38:10519:x1875475136824320:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 587us (1152us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788592738.730465:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:0.0:1788592738.738610:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.738883:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824448 00000100:00100000:2.0:1788592738.738895:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824448 00000100:00100000:2.0:1788592738.739025:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:2.0:1788592738.739039:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136824448:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:2.0:1788592738.739101:0:8688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.739129:0:8688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.739140:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592738.739145:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592738.739151:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.739199:0:8688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.739217:0:8688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 8 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.739233:0:8688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8688:1875475147325952:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592738.739432:0:8688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592738.742634:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.743238:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824576 00000100:00100000:1.0:1788592738.743253:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824576 00002000:00100000:1.0:1788592738.743330:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8981bc851f80 x1875475136824576/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:14/0 lens 504/0 e 0 to 0 dl 1788592749 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592738.743342:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc851f80 with x1875475136824576 ext(0->8) 00010000:00010000:1.0:1788592738.743387:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.743408:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 9 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592738.743443:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bc851f80 00000100:00100000:1.0:1788592738.743485:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:1.0:1788592738.743495:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2344:x1875475136824576:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:1.0:1788592738.744536:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:2344:x1875475136824576:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 1032us (1916us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788592738.744549:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00002000:00100000:1.0:1788592738.744561:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8981bc851f80 x1875475136824576/t4294967302(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:14/0 lens 504/448 e 0 to 0 dl 1788592749 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592738.744571:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc851f80 with x1875475136824576 ext(0->8) 00010000:00010000:1.0:1788592738.744579:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.744596:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592738.744602:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bc851f80 00000100:00100000:2.0:1788592738.748074:0:8688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8688:1875475147325952:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592738.748122:0:8688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592738.750150:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.750346:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824704 00000100:00100000:1.0:1788592738.750400:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824704 00010000:00010000:1.0:1788592738.750455:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592738.750496:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1788592738.750507:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:2342:x1875475136824704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592738.750544:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788592738.750570:0:5809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788592738.750574:0:5809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788592737 00002000:00010000:1.0:1788592738.750577:0:5809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788592737 00002000:00010000:1.0:1788592738.750579:0:5809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788592737 00010000:00010000:1.0:1788592738.750588:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.750605:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.750632:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfd173d1/0x27b316f13251110f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1af9 expref: 11 pid: 6676 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.750655:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592738.750660:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592738.750678:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.750700:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592738.750741:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592738.750819:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2342:x1875475136824704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 314us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592738.750828:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00010000:00010000:2.0:1788592738.751186:0:8688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751199:0:8688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751241:0:8688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751250:0:8688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751258:0:8688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751265:0:8688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5a00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592738.751269:0:8688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751278:0:8688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751306:0:8688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.751314:0:8688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000099e746c/0x27b316f13251114e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.751426:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2341:x1875475136824448:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 12389us (12833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592738.751434:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:0.0:1788592738.755673:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592738.755740:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136824960 00000100:00100000:3.0:1788592738.755755:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136824960 00000100:00100000:3.0:1788592738.755836:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:3.0:1788592738.755848:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+38:10519:x1875475136824960:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:3.0:1788592738.755941:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b0e expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592738.757552:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788592738.757884:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788592738.758467:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788592738.758595:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.759030:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.759047:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.759103:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 42 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.759134:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 42 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.759178:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147326080:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592738.759463:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592738.764626:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147326080:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592738.764673:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592738.765007:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592738.765189:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825088 00000100:00100000:1.0:1788592738.765198:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825088 00010000:00010000:1.0:1788592738.765318:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 43 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.765488:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1788592738.765501:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+43:2343:x1875475136825088:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592738.765521:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592738.765531:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 43 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.765556:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 43 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.765586:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325110fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aeb expref: 43 pid: 5823 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.765610:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592738.765617:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.765628:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.765638:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.765803:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592738.765882:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+42:2343:x1875475136825088:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 382us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592738.765892:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00010000:00010000:2.0:1788592738.766249:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.766259:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592738.766491:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788592738.766794:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788592738.766934:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147326208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592738.767009:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592738.767047:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592738.767137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326208 00000100:00100000:3.0:1788592738.767145:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326208 00000100:00100000:3.0:1788592738.767202:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592738.767212:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1875475147326208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788592738.767297:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1875475147326208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 87us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592738.767305:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592738.767891:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147326208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788592738.768551:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788592738.768640:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147326336:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592738.768715:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592738.768737:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788592738.769451:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326336 00000100:00100000:3.0:1788592738.769462:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326336 00000100:00100000:3.0:1788592738.769516:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592738.769527:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5826:x1875475147326336:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788592738.770561:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5826:x1875475147326336:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1030us (1839us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788592738.770577:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592738.770790:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147326336:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788592738.770883:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788592738.771188:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771202:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771210:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771217:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.771315:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771325:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771345:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592738.771381:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788592738.771388:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.771396:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511155 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592738.771975:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788592738.772111:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788592738.772125:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313012774813ns, next at 314012772134ns, rc = 0 00000001:00080000:2.0:1788592738.772135:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788592738.772190:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592738.772194:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788592738.772204:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132511140 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b0e expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.772942:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+45:10519:x1875475136824960:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 16668us (16872us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788592738.772957:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000020:00080000:2.0:1788592738.772965:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788592738.776825:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.777032:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825216 00000100:00100000:2.0:1788592738.777046:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825216 00000100:00100000:2.0:1788592738.777117:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:2.0:1788592738.777130:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+45:10519:x1875475136825216:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592738.777171:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592738.777203:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251115c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b15 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.777866:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b15 expref: 46 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.777889:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251115c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b15 expref: 46 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.777965:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:0.0:1788592738.777969:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592738.777974:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5a00, rc 0) 00000100:00100000:0.0:1788592738.778054:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+46:10519:x1875475136825216:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 927us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592738.778061:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1788592738.782599:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.783138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825472 00000100:00100000:2.0:1788592738.783152:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825472 00000100:00100000:2.0:1788592738.783449:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:2.0:1788592738.783467:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+46:10519:x1875475136825472:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592738.783807:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10519:x1875475136825472:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 344us (1221us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788592738.784877:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1788592738.877510:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.877805:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825600 00000100:00100000:2.0:1788592738.877818:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825600 00000100:00100000:2.0:1788592738.877898:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:2.0:1788592738.877911:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10529:x1875475136825600:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1788592738.878027:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878053:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878067:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878085:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878092:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878116:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878472:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878482:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878489:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592738.878613:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878697:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878705:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878713:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878719:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.878724:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878733:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878749:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592738.878762:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.878768:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878776:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f132511163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878792:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878798:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878803:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878808:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.878811:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878817:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878825:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981a1fe1500) 00010000:00010000:2.0:1788592738.878828:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.878831:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878837:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251116a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878853:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878866:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878871:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878876:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592738.878879:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878885:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878892:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592738.878895:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592738.878909:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592738.878915:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592738.879083:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10529:x1875475136825600:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1172us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592738.879093:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:1.0:1788592738.928465:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592738.928587:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825856 00000100:00100000:0.0:1788592738.928601:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825856 00000100:00100000:0.0:1788592738.928703:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:0.0:1788592738.928716:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+47:10532:x1875475136825856:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592738.928744:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592738.928773:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b1c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928873:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928893:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928907:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928949:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928957:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.928964:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929122:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f13251118d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929132:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f13251118d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929139:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f13251118d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592738.929152:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788592738.929287:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929296:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929303:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929310:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592738.929315:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929335:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929384:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592738.929388:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592738.929394:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929401:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251117f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929416:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929423:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929429:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929435:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592738.929438:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929444:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929452:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff898185c2d100) 00010000:00010000:0.0:1788592738.929454:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592738.929457:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929473:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929526:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b1c expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929541:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f13251118d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b1c expref: 49 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592738.929548:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:0.0:1788592738.929550:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592738.929553:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca200, rc 0) 00000100:00100000:0.0:1788592738.929640:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+49:10532:x1875475136825856:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 926us (1189us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788592738.929648:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:1.0:1788592738.940048:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592738.940485:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136825984 00000100:00100000:3.0:1788592738.940498:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136825984 00000100:00100000:3.0:1788592738.940813:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:3.0:1788592738.940846:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+49:10532:x1875475136825984:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1788592738.940947:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.940970:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.940986:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941018:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941026:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941035:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941041:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592738.941046:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941053:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941067:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592738.941071:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592738.941077:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592738.941084:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251119b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592738.941902:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+49:10532:x1875475136825984:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 1053us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592738.941915:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:1.0:1788592738.946878:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592738.947852:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136826240 00000100:00100000:2.0:1788592738.947869:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136826240 00000100:00100000:2.0:1788592738.947938:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:2.0:1788592738.947952:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+49:10532:x1875475136826240:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592738.948665:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10532:x1875475136826240:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 710us (1798us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788592738.948704:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1788592739.050042:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.050168:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136826496 00000100:00100000:0.0:1788592739.050181:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136826496 00000100:00100000:0.0:1788592739.050255:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:0.0:1788592739.050268:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+50:10542:x1875475136826496:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592739.050316:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592739.050320:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592739.050385:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f13251111d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b00 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.050414:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592739.050421:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592739.050458:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325111a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b23 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.050599:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325111a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.050616:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325111a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.050869:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325111a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592739.050884:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788592739.051061:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325111a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b23 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.051079:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325111a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b23 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.051088:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:0.0:1788592739.051091:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592739.051095:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592739.051175:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10542:x1875475136826496:12345-192.168.204.20@tcp:101:bash.0 Request processed in 909us (1148us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788592739.051184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:1.0:1788592739.054607:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.058927:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136826752 00000100:00100000:2.0:1788592739.058953:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136826752 00000100:00100000:2.0:1788592739.059054:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 105 00000100:00100000:2.0:1788592739.059068:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10542:x1875475136826752:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:2.0:1788592739.059427:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788592739.059468:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325111a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b23 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.059499:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f13251118d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b1c expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.059511:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592739.059518:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592739.059972:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.059990:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.060003:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592739.060068:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788592739.060096:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073deed54 reply state 000000004b64c0c7 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592739.060105:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592739.060888:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10542:x1875475136826752:12345-192.168.204.20@tcp:36:bash.0 Request processed in 1818us (6292us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788592739.060901:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 105 00000020:00080000:2.0:1788592739.060908:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592739.071567:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592739.071595:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592739.071705:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592739.071797:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326464 00000100:00100000:1.0:1788592739.071806:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326464 00000100:00100000:1.0:1788592739.071875:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592739.071888:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147326464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592739.071937:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592739.071989:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147326464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.071996:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788592739.072025:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592739.072063:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592739.073083:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147326592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592739.073135:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592739.073266:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326592 00000100:00100000:0.0:1788592739.073286:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326592 00000100:00100000:0.0:1788592739.073374:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592739.073384:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1875475147326592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592739.073407:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592739.073459:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3283:x1875475147326592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592739.073466:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592739.073511:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc852d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147326592:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788592739.073810:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788592739.080900:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080920:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080929:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080935:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592739.080941:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080950:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080971:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592739.080975:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592739.080981:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.080987:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592739.081110:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592739.081144:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136826880 00000100:00100000:1.0:1788592739.081155:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136826880 00000100:00100000:1.0:1788592739.081208:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:1.0:1788592739.081218:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+51:10542:x1875475136826880:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592739.081252:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592739.081280:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325111be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b2a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081436:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081450:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081463:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592739.081498:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788592739.081502:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592739.081525:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081555:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325111be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 53 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081574:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 52 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.081581:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592739.081584:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592739.081586:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be200, rc 0) 00000100:00100000:1.0:1788592739.081893:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10542:x1875475136826880:12345-192.168.204.20@tcp:101:bash.0 Request processed in 674us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.081901:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:2.0:1788592739.082196:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147327104:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082259:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592739.082322:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592739.082330:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147326720:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082385:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592739.082421:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326720 00000100:00100000:2.0:1788592739.082427:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326720 00000100:00100000:2.0:1788592739.082464:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788592739.082472:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082516:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147326720:12345-0@lo:400:kworker.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.082523:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788592739.082559:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082587:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592739.082609:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592739.082615:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147326976:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082690:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592739.082740:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147326720:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082767:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147327104 00000100:00100000:2.0:1788592739.082770:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147327104 00000100:00080000:2.0:1788592739.082793:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592739.082814:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326848 00000100:00100000:2.0:1788592739.082817:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326848 00000100:00100000:2.0:1788592739.082839:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147326976 00000100:00100000:2.0:1788592739.082842:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147326976 00000100:00080000:2.0:1788592739.082856:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592739.082870:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788592739.082875:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147327104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082913:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147327104:12345-0@lo:400:kworker.0 Request processed in 37us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.082920:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788592739.082945:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147327104:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082961:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788592739.082967:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147326848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.082996:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147326848:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.083001:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788592739.083021:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147326848:0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.083035:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788592739.083040:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147326976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592739.083069:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147326976:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.083074:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788592739.083093:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147326976:0@lo:400:kworker.0 00000100:00100000:1.0:1788592739.086514:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.086987:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827136 00000100:00100000:2.0:1788592739.087001:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827136 00000100:00100000:2.0:1788592739.087071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:2.0:1788592739.087082:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+52:10542:x1875475136827136:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1788592739.087652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10542:x1875475136827136:12345-192.168.204.20@tcp:35:bash.0 Request processed in 568us (1151us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788592739.087661:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1788592739.173834:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.174004:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827264 00000100:00100000:2.0:1788592739.174019:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827264 00000100:00100000:2.0:1788592739.174134:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:2.0:1788592739.174147:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+53:10548:x1875475136827264:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592739.174179:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592739.174208:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f1325111cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b31 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174311:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174331:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174407:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592739.174460:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788592739.174465:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592739.174492:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174524:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f1325111cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b31 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174546:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b31 expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.174566:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592739.174569:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592739.174575:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5800, rc 0) 00000100:00100000:2.0:1788592739.174821:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136827264:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 676us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.174829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 107 00000100:00100000:1.0:1788592739.178322:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.178868:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827392 00000100:00100000:2.0:1788592739.178882:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827392 00000100:00100000:2.0:1788592739.179002:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:2.0:1788592739.179016:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136827392:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592739.179045:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592739.179074:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325111da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b38 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179164:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179181:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179195:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179212:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179220:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179247:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179515:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179592:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179603:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592739.179826:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788592739.179832:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592739.179854:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179869:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179879:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179886:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179892:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179899:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592739.179904:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179921:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179936:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:2.0:1788592739.179939:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592739.179945:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179952:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325111e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179968:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179973:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179980:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179985:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592739.179988:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179993:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.179999:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981a1fe1500) 00010000:00010000:2.0:1788592739.180002:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592739.180005:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.180020:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325111e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.180060:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325111da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b38 expref: 56 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.180075:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b38 expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.180083:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592739.180085:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592739.180088:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:2.0:1788592739.180176:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10548:x1875475136827392:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1162us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.180185:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:1.0:1788592739.183984:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592739.184033:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827520 00000100:00100000:1.0:1788592739.184045:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827520 00000100:00100000:1.0:1788592739.184114:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592739.184127:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+55:2344:x1875475136827520:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592739.184144:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592739.184175:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325111ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b38 expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.184198:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592739.184205:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592739.184265:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:2344:x1875475136827520:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 140us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.184274:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592739.187741:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.187846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827776 00000100:00100000:3.0:1788592739.187860:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827776 00000100:00100000:3.0:1788592739.187931:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:3.0:1788592739.187945:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136827776:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592739.187974:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.188002:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325111f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b3f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.188136:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.188153:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.188163:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.188206:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.188223:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 55 pid: 6700 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592739.188239:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147327232:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592739.188741:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981989056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592739.192202:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.192545:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136827904 00000100:00100000:0.0:1788592739.192558:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136827904 00010000:00010000:0.0:1788592739.192612:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 56 pid: 6700 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592739.192669:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1788592739.192690:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+56:2343:x1875475136827904:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592739.192709:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592739.192717:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 56 pid: 6700 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.192734:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 56 pid: 6700 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.192762:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:0.0:1788592739.192768:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.192780:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.192789:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.192820:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592739.192971:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+56:2343:x1875475136827904:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 283us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592739.192981:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00010000:00010000:3.0:1788592739.194567:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f1325111c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b2a expref: 55 pid: 6700 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592739.194600:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaa8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147327232:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592739.194645:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.194657:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.194664:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592739.194701:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788592739.194905:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325111f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 56 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.194925:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.194934:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592739.194937:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592739.194942:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5800, rc 0) 00000100:00100000:3.0:1788592739.195059:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10548:x1875475136827776:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 7117us (7332us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788592739.195069:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:1.0:1788592739.199070:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.199181:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828160 00000100:00100000:2.0:1788592739.199195:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828160 00000100:00100000:2.0:1788592739.199483:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1788592739.199496:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10548:x1875475136828160:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:2.0:1788592739.199518:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592739.199557:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251115c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b15 expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.199579:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592739.199587:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592739.199658:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136828160:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 164us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.199694:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592739.202080:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.202178:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828288 00000100:00100000:3.0:1788592739.202207:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828288 00000100:00100000:3.0:1788592739.202290:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:3.0:1788592739.202303:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136828288:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:3.0:1788592739.202495:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.202519:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.202546:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592739.202839:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788592739.202949:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136828288:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 648us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.202959:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:1.0:1788592739.205312:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.205473:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828416 00000100:00100000:3.0:1788592739.205485:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828416 00000100:00100000:3.0:1788592739.205564:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:3.0:1788592739.205576:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:10548:x1875475136828416:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592739.205605:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.205633:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b46 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205722:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205736:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205782:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205798:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205815:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592739.205818:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592739.205822:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.205831:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5600, rc 0) 00000100:00100000:3.0:1788592739.205901:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10548:x1875475136828416:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 328us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.205909:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00010000:00010000:1.0:1788592739.584292:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592739.647463:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592739.647477:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592739.647562:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788592739.647571:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592739.647742:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc852d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147327360:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788592739.648000:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592739.674085:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.674385:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828544 00000100:00100000:3.0:1788592739.674399:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828544 00000100:00100000:3.0:1788592739.674486:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:3.0:1788592739.674499:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136828544:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592739.674584:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592739.674766:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136828544:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 252us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.674777:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:0.0:1788592739.675195:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc852d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147327360:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788592739.678953:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.679313:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828672 00000100:00100000:2.0:1788592739.679327:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828672 00000100:00100000:2.0:1788592739.679751:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:2.0:1788592739.679765:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10549:x1875475136828672:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788592739.679869:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.679892:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.679910:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.679975:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.679983:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.679991:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680021:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680030:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680037:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592739.680113:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788592739.680119:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592739.680136:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680149:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680158:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680166:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680172:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592739.680178:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680187:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680203:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:2.0:1788592739.680207:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592739.680214:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680220:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511219 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680236:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680252:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680257:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680274:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592739.680278:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680286:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680294:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8981a1fe1500) 00010000:00010000:2.0:1788592739.680297:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592739.680300:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680306:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511220 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680324:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680330:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680335:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.680339:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592739.681051:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.681064:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.681076:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592739.681079:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592739.681082:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.681089:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f132511227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592739.681227:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10549:x1875475136828672:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 1463us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.681238:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:2.0:1788592739.685125:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.687472:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136828928 00000100:00100000:3.0:1788592739.687527:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136828928 00000100:00100000:3.0:1788592739.687616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1788592739.687629:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+55:10549:x1875475136828928:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592739.687658:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.687698:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251122e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b4d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.687839:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688140:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688159:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592739.688175:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788592739.688319:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688328:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688335:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688341:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592739.688395:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688406:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688436:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592739.688440:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592739.688448:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688455:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688518:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251122e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b4d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688531:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:3.0:1788592739.688546:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592739.688551:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f13251122e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b4d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.688564:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4400, rc 0) 00000100:00100000:3.0:1788592739.688653:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136828928:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1027us (3548us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788592739.688663:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 114 00000100:00100000:3.0:1788592739.693950:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.694111:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136829056 00000100:00100000:0.0:1788592739.694126:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136829056 00000100:00100000:0.0:1788592739.694200:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:0.0:1788592739.694214:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136829056:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788592739.694276:0:5824:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788592739.694448:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136829056:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 236us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592739.694456:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 115 00000100:00100000:3.0:1788592739.699440:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.699515:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136829312 00000100:00100000:3.0:1788592739.699528:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136829312 00000100:00100000:3.0:1788592739.699596:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1788592739.699608:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136829312:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592739.699639:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.699659:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788592739.699717:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325111d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b31 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.699742:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592739.699750:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592739.699769:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132511243 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b54 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788592739.700434:0:6700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788592739.700691:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251124a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.700710:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.700724:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251124a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.700787:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f132511243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b54 expref: 58 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.700807:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251124a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b54 expref: 57 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.700816:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:3.0:1788592739.700819:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592739.700822:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5000, rc 0) 00000100:00100000:3.0:1788592739.700896:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10549:x1875475136829312:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1290us (1474us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788592739.700917:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 116 00000100:00100000:3.0:1788592739.705011:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.705118:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136829568 00000100:00100000:0.0:1788592739.705132:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136829568 00000100:00100000:0.0:1788592739.705325:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:0.0:1788592739.705339:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10549:x1875475136829568:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592739.705713:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592739.705749:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251124a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b54 expref: 57 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705791:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:0.0:1788592739.705806:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592739.705833:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705851:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705861:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705879:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705887:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705894:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705978:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705987:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.705994:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706001:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592739.706006:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706022:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706031:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:0.0:1788592739.706035:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592739.706039:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706047:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511258 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706122:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706130:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706137:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706143:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592739.706213:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706220:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706228:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc839d902 (ffff898185c2d100) 00010000:00010000:0.0:1788592739.706231:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592739.706234:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.706251:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251125f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc839d902 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592739.706740:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136829568:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1400us (1738us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592739.706751:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 117 00000100:00100000:3.0:1788592739.712872:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592739.713084:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136829696 00000100:00100000:1.0:1788592739.713099:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136829696 00000100:00100000:1.0:1788592739.713172:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1788592739.713185:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+56:10549:x1875475136829696:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592739.713215:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592739.713267:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b5b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713320:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713340:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713374:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713496:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 58 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713522:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 57 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.713533:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:1.0:1788592739.713537:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592739.713542:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be000, rc 0) 00000100:00100000:1.0:1788592739.713627:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10549:x1875475136829696:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 444us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.713635:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 118 00000100:00100000:1.0:1788592739.724608:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.724767:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136829952 00000100:00100000:2.0:1788592739.724780:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136829952 00000100:00100000:2.0:1788592739.724867:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 119 00000100:00100000:2.0:1788592739.724880:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+57:10549:x1875475136829952:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592739.724990:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.725014:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.725031:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592739.725433:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788592739.725447:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313966096386ns, next at 314966092098ns, rc = 0 00000004:00010000:2.0:1788592739.725574:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6b8b3b9 reply state 00000000367f9ed2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592739.725587:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592739.725732:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+59:10549:x1875475136829952:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 854us (1139us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788592739.725741:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 119 00010000:00010000:3.0:1788592739.731990:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732013:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732022:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732029:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592739.732035:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732045:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732070:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:3.0:1788592739.732074:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592739.732080:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.732087:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511274 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592739.745253:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.745398:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830080 00000100:00100000:3.0:1788592739.745412:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830080 00000100:00100000:3.0:1788592739.745473:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:3.0:1788592739.745484:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+58:10549:x1875475136830080:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592739.745540:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.745577:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b62 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.745657:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 59 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.745685:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 59 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.745708:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:3.0:1788592739.745711:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592739.745716:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4600, rc 0) 00000100:00100000:3.0:1788592739.745790:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+59:10549:x1875475136830080:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 308us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.745798:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:2.0:1788592739.750497:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.750624:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830208 00000100:00100000:0.0:1788592739.750638:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830208 00000100:00100000:0.0:1788592739.750737:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:0.0:1788592739.750748:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136830208:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788592739.751181:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2344:x1875475136830208:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 432us (699us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788592739.751191:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00080000:2.0:1788592739.752738:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592739.755299:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.755695:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830464 00000100:00100000:0.0:1788592739.755709:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830464 00000100:00100000:0.0:1788592739.755787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:0.0:1788592739.755800:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+59:10549:x1875475136830464:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592739.756138:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+60:10549:x1875475136830464:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 341us (854us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788592739.756146:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1788592739.763956:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.764571:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830720 00000100:00100000:2.0:1788592739.764587:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830720 00000100:00100000:2.0:1788592739.764677:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:2.0:1788592739.764691:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+60:10549:x1875475136830720:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592739.764849:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+60:10549:x1875475136830720:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 160us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.764857:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:3.0:1788592739.772497:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592739.773017:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830848 00000100:00100000:1.0:1788592739.773032:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830848 00000100:00100000:1.0:1788592739.773093:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1788592739.773125:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+60:10549:x1875475136830848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592739.773153:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592739.773181:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b69 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773286:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773305:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773322:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592739.773403:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592739.773426:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773457:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b69 expref: 62 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773481:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b69 expref: 61 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592739.773490:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:1.0:1788592739.773494:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788592739.773498:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf400, rc 0) 00000100:00100000:1.0:1788592739.773577:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:10549:x1875475136830848:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 455us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.773596:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 122 00000100:00100000:1.0:1788592739.781148:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592739.782825:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136830976 00000100:00100000:3.0:1788592739.782848:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136830976 00000100:00100000:3.0:1788592739.782936:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1788592739.782950:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2342:x1875475136830976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592739.782986:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592739.783018:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b70 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592739.783057:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc262, blocks: 0x1 00010000:00010000:3.0:1788592739.783105:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=314s v=(0 0) 00010000:00010000:3.0:1788592739.783111:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592739.783125:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.783151:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 10 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592739.783167:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4a00, rc 0) 00000100:00100000:3.0:1788592739.783258:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2342:x1875475136830976:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 312us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592739.783266:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1788592739.793691:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.794090:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831232 00000100:00100000:2.0:1788592739.794105:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831232 00000100:00100000:2.0:1788592739.794183:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:2.0:1788592739.794196:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+61:10549:x1875475136831232:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788592739.794396:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+61:10549:x1875475136831232:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 202us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.794406:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:0.0:1788592739.797995:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592739.798190:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831360 00000100:00100000:2.0:1788592739.798204:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831360 00000100:00100000:2.0:1788592739.798291:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1788592739.798304:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:10549:x1875475136831360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592739.798330:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592739.798412:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b77 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.798455:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.798465:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592739.798469:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592739.798477:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.798980:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.799002:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 11 pid: 6678 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592739.799019:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147327488:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592739.799212:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592739.815476:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.815606:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831488 00000100:00100000:0.0:1788592739.815620:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831488 00010000:00010000:0.0:1788592739.815700:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 12 pid: 6678 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592739.815780:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1788592739.815790:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2344:x1875475136831488:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788592739.815799:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc814700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147327488:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592739.815811:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592739.815840:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 12 pid: 6678 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.815841:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.815856:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 12 pid: 6678 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.815884:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcf22e5/0x27b316f132511290 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b70 expref: 12 pid: 6678 timeout: 414 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.815905:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592739.815910:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592739.815920:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592739.815932:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592739.821755:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4000, rc 0) 00000100:00100000:2.0:1788592739.821896:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:10549:x1875475136831360:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 23587us (23913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592739.821908:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00010000:00010000:0.0:1788592739.822139:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592739.822167:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1875475147327616:192.168.204.20@tcp:105: 00000100:00100000:0.0:1788592739.822258:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592739.836317:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1875475147327616:192.168.204.20@tcp:105: 00010000:00010000:0.0:1788592739.836389:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592739.837321:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2344:x1875475136831488:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 21523us (21852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592739.837337:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1788592739.845068:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592739.846060:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831616 00000100:00100000:0.0:1788592739.846079:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831616 00002000:00100000:0.0:1788592739.846158:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8981bcaab100 x1875475136831616/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:15/0 lens 504/0 e 0 to 0 dl 1788592750 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592739.846171:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaab100 with x1875475136831616 ext(0->12) 00002000:00010000:0.0:1788592739.846179:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaab100 00000100:00100000:0.0:1788592739.846222:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1788592739.846232:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2343:x1875475136831616:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788592739.848163:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2343:x1875475136831616:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 1920us (3102us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788592739.848179:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:2.0:1788592739.848201:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8981bcaab100 x1875475136831616/t4294967308(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:15/0 lens 504/448 e 0 to 0 dl 1788592750 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592739.848213:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaab100 with x1875475136831616 ext(0->12) 00002000:00010000:2.0:1788592739.848221:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaab100 00000100:00100000:3.0:1788592739.852319:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592739.852752:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831744 00000100:00100000:1.0:1788592739.852767:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831744 00000100:00100000:1.0:1788592739.852833:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:1.0:1788592739.852844:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:10549:x1875475136831744:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788592740.026239:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:10549:x1875475136831744:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 173378us (173917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.026275:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00000001:00080000:3.0:1788592740.026332:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788592740.026421:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788592740.026450:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788592740.026472:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8981862b7cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788592740.026478:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898191112000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8981862b7300 00000020:00080000:3.0:1788592740.026482:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898191112200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981886f7000 00000020:00080000:3.0:1788592740.026508:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8981bc634480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788592740.026512:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898184fae500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc6346c0 00000020:00080000:3.0:1788592740.026531:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898184fae100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc802400 00000004:00080000:3.0:1788592740.026559:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788592740.026586:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788592740.026719:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788592740.026961:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788592740.027814:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147327872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788592740.027919:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.028019:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592740.028028:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147328000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788592740.028051:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.028086:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592740.028096:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147327744:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788592740.028124:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.028165:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147327872 00000100:00100000:2.0:1788592740.028174:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147327872 00000100:00100000:1.0:1788592740.028178:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147328000 00000100:00100000:1.0:1788592740.028181:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147328000 00000100:00100000:1.0:1788592740.028222:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147327744 00000100:00100000:1.0:1788592740.028225:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147327744 00000100:00100000:3.0:1788592740.028705:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788592740.028720:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3285:x1875475147328000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788592740.028942:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788592740.028946:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788592739 00002000:00010000:3.0:1788592740.028949:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788592740.028951:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788592738 -> 1788592739 00002000:00010000:3.0:1788592740.028954:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788592740.029017:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3285:x1875475147328000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 300us (964us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788592740.029025:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788592740.029134:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bca9f480/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788592740.029144:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147328000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788592740.033073:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592740.033109:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3285:x1875475147327872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788592740.033167:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1788592740.033232:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592740.033240:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788592740.033251:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3283:x1875475147327744:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788592740.033262:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788592740.033266:0:8688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788592740.033273:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788592740.033279:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592740.033285:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592740.033301:0:8688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9bc261, atime: 0x6a9bc261, ctime: 0x6a9bc261, blocks: 0x1 00010000:00010000:1.0:1788592740.033307:0:8688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.033315:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=314s v=(0 0) 00010000:00010000:1.0:1788592740.033318:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592740.033324:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.033333:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.033648:0:8688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.033675:0:8688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.033684:0:8688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.033970:0:8688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592740.034988:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592740.035001:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.035013:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc172b4f0) 00000100:00100000:0.0:1788592740.035013:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3283:x1875475147327744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1762us (6885us total) trans 4294967304 rc 0/0 00010000:00010000:1.0:1788592740.035019:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.035024:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788592740.035029:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.035052:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.035495:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49caf89/0x27b316f1325112a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.035544:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592740.035556:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592740.035559:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592740.035653:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 11 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.035688:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147328128:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592740.035796:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b70c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788592740.035928:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bcaab480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788592740.035936:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147327744:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788592740.044565:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.044928:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136831872 00000100:00100000:0.0:1788592740.044942:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136831872 00000100:00100000:0.0:1788592740.045019:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1788592740.045031:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2344:x1875475136831872:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788592740.046145:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592740.046538:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc817100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147328128:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592740.046589:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.058401:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832000 00000100:00100000:0.0:1788592740.058427:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832000 00010000:00010000:0.0:1788592740.058505:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 13 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.060217:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:0.0:1788592740.060237:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2344:x1875475136832000:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592740.060264:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592740.060276:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 13 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.060294:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 13 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.060327:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f132511060 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ad6 expref: 13 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.061892:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592740.061907:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592740.061918:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.061935:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.062078:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592740.062173:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2344:x1875475136832000:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 1941us (16032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592740.062185:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00010000:00010000:3.0:1788592740.072250:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.072277:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.072294:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.072303:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.074634:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788592740.075539:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3285:x1875475147327872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42441us (47611us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788592740.075552:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788592740.075820:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bca9df80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788592740.075829:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147327872:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788592740.076518:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592740.076532:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.076548:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592740.076554:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.076569:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.076595:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.076605:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f13251129e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.076630:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592740.076633:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592740.076634:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788592740.217150:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788592740.217183:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788592740.217196:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788592740.238449:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1788592740.238500:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788592740.238811:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136831872:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 193772us (194256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.238826:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:2.0:1788592740.245626:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592740.245706:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832256 00000100:00100000:3.0:1788592740.245720:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832256 00000100:00080000:2.0:1788592740.245908:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592740.245918:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 125 00000100:00100000:3.0:1788592740.245931:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10549:x1875475136832256:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592740.246028:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592740.246071:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b69 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.246102:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:3.0:1788592740.246109:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592740.246153:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.246171:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.246183:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592740.246843:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d64fe5fd reply state 000000008b16842a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.246879:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592740.247028:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+16:10549:x1875475136832256:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1097us (1417us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788592740.247037:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 125 00010000:00010000:2.0:1788592740.252553:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592740.252575:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1788592740.252582:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.252593:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.252600:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592740.252607:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.252619:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.252644:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:2.0:1788592740.252648:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592740.252666:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.252674:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325112ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592740.252767:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832384 00000100:00100000:3.0:1788592740.252782:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832384 00000100:00100000:3.0:1788592740.252859:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1788592740.252871:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136832384:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788592740.253181:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788592740.253186:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788592739 -> 1788592738 00002000:00010000:3.0:1788592740.253189:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788592737 00002000:00010000:3.0:1788592740.253192:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788592739 -> 1788592738 00002000:00010000:3.0:1788592740.253194:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788592740.253271:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136832384:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 401us (706us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788592740.253300:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1788592740.259772:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.260051:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832640 00000100:00100000:0.0:1788592740.260066:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832640 00000100:00100000:0.0:1788592740.260143:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:0.0:1788592740.260155:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+15:10549:x1875475136832640:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788592740.260279:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.260302:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.260313:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.260393:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.260413:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 15 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.260432:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147328256:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592740.260545:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592740.267071:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592740.267328:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832768 00000100:00100000:1.0:1788592740.267344:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832768 00010000:00010000:1.0:1788592740.267473:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592740.267533:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1788592740.267547:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:2344:x1875475136832768:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592740.267567:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592740.267576:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.267592:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.267647:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:1.0:1788592740.267665:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.267679:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.267688:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.267714:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592740.267799:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:2344:x1875475136832768:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 254us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592740.267809:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00010000:00010000:0.0:1788592740.267994:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f13251126d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b5b expref: 15 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.268030:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147328256:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592740.268067:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268080:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268086:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268134:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268142:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268148:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268153:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592740.268158:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268165:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268176:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:0.0:1788592740.268179:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788592740.268194:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.268200:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f1325112b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.268278:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10549:x1875475136832640:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 8126us (8525us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788592740.268287:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1788592740.276668:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592740.277415:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136832896 00000100:00100000:1.0:1788592740.277431:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136832896 00000100:00100000:1.0:1788592740.277526:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1788592740.277539:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb47d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136832896:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788592740.277605:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.277633:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.277643:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592740.277648:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592740.277665:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.277727:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.277745:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 7 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592740.277763:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147328384:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592740.277877:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818b68e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592740.288071:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592740.289426:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833024 00000100:00100000:3.0:1788592740.289444:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833024 00010000:00010000:3.0:1788592740.289529:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 8 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592740.289583:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:3.0:1788592740.289595:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136833024:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592740.289615:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788592740.289639:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875475147328384:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592740.289671:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 8 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.289684:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.289689:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 8 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.289730:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b77 expref: 8 pid: 6677 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.289753:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592740.289759:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592740.289767:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.289779:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.289842:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592740.289935:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136833024:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 341us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.289942:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00010000:00010000:2.0:1788592740.290144:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290155:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290186:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290196:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290206:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290215:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592740.290221:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290231:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290258:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.290267:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325112ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.290344:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb47d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136832896:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 12806us (13704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.290633:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:1.0:1788592740.300071:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.300492:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833280 00000100:00100000:0.0:1788592740.300507:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833280 00000100:00100000:0.0:1788592740.300663:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:0.0:1788592740.300677:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10549:x1875475136833280:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592740.300799:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.300824:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.300842:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.301129:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.301144:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.301155:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.301221:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.301237:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 15 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.301254:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147328512:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592740.301663:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592740.306961:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592740.307061:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833408 00000100:00100000:3.0:1788592740.307076:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833408 00010000:00010000:3.0:1788592740.307143:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592740.307207:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592740.307222:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+16:2343:x1875475136833408:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592740.307243:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592740.307263:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592740.307274:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147328512:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592740.307282:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.307321:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251127b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b62 expref: 16 pid: 6700 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.312424:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.312777:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:3.0:1788592740.312787:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.312801:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.312834:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592740.312954:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592740.313062:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+15:2343:x1875475136833408:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 5836us (6110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592740.313076:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00010000:00010000:2.0:1788592740.313212:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.313221:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592740.313553:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788592740.313768:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788592740.313817:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788592740.313927:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc817800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147328640:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788592740.314010:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592740.314049:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592740.318688:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147328640 00000100:00100000:2.0:1788592740.318716:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147328640 00000100:00100000:2.0:1788592740.318799:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592740.318808:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788592740.318816:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875475147328640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788592740.318831:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788592740.321566:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1875475147328640:12345-0@lo:1000:mdt00_002.0 Request processed in 2741us (7540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.321604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592740.322977:0:5824:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788592740.322994:0:5824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788592740.323254:0:5824:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bca9f480, transno 4294967309 00000100:00100000:0.0:1788592740.323380:0:5824:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8981bca9df80 x1875475147327872/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788592756 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592740.323399:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc817800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147328640:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788592740.324580:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788592740.324784:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147328768:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788592740.324888:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592740.325006:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592740.325819:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147328768 00000100:00100000:2.0:1788592740.325832:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147328768 00000100:00100000:0.0:1788592740.326038:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592740.326065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1875475147328768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788592740.326407:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5824:x1875475147328768:12345-0@lo:1000:mdt00_002.0 Request processed in 344us (1518us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788592740.326417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592740.326529:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc850e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5824:1875475147328768:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788592740.326587:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326602:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326611:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326618:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592740.326624:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326644:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326677:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289a800) 00010000:00010000:2.0:1788592740.326681:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592740.326687:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326695:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325112c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326740:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326760:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326765:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326770:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592740.326773:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326779:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326789:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592740.326792:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592740.326800:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326812:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326822:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.326864:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.326880:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147328896:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592740.326990:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592740.334849:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.334967:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592740.335229:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833664 00000100:00100000:3.0:1788592740.335244:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833664 00000100:00100000:1.0:1788592740.335440:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833536 00000100:00100000:1.0:1788592740.335446:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833536 00000100:00100000:3.0:1788592740.335491:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:1.0:1788592740.335492:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00100000:1.0:1788592740.335505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136833536:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592740.335521:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136833664:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592740.335605:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136833536:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 102us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592740.335613:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 292 00000100:00080000:2.0:1788592740.335649:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592740.335711:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136833664:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 207us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.335719:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1788592740.335798:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.335983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592740.336112:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147328896:192.168.204.20@tcp:105: 00010000:00010000:2.0:1788592740.336152:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336167:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251120b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336213:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336233:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336247:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336260:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336267:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336275:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336281:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592740.336286:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336295:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336328:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592740.336332:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592740.336337:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.336343:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592740.336676:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833792 00000100:00100000:3.0:1788592740.336684:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833792 00000100:00100000:1.0:1788592740.336795:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136833920 00000100:00100000:1.0:1788592740.336800:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136833920 00000100:00100000:1.0:1788592740.336844:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:1.0:1788592740.336854:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10548:x1875475136833920:12345-192.168.204.20@tcp:49:lfs.0 00000100:00100000:1.0:1788592740.336992:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:10548:x1875475136833920:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 139us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592740.337000:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00080000:0.0:1788592740.337889:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788592740.338598:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338610:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338619:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338626:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592740.338631:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338640:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338755:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592740.338759:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592740.338767:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.338775:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325112c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592740.338980:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:3.0:1788592740.339008:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136833792:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592740.339110:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136833792:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 108us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.339119:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:2.0:1788592740.339288:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+18:10549:x1875475136833280:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 38613us (39234us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788592740.339298:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00000020:00080000:2.0:1788592740.339303:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788592740.340046:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592740.340055:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592740.340970:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788592740.341167:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592740.350756:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592740.350949:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592740.351128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136834176 00000100:00100000:2.0:1788592740.351146:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136834176 00000100:00100000:2.0:1788592740.351228:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:2.0:1788592740.351240:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:10548:x1875475136834176:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:2.0:1788592740.352390:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788592740.352539:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:10548:x1875475136834176:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1297us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.352552:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 128 00000100:00100000:1.0:1788592740.353624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136834432 00000100:00100000:1.0:1788592740.353639:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136834432 00000100:00100000:1.0:1788592740.353720:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1788592740.353731:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+18:10549:x1875475136834432:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788592740.355717:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788592740.356156:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788592740.356253:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356279:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356295:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356306:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356313:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356320:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592740.356589:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788592740.356773:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+20:10549:x1875475136834432:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 3037us (5817us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788592740.356804:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000020:00080000:1.0:1788592740.356811:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788592740.357296:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592740.357307:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.357319:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592740.357324:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.357336:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.357376:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89818289aa00) 00010000:00010000:2.0:1788592740.357381:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788592740.357387:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.357411:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325112d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.357440:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592740.357442:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592740.357444:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592740.402039:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592740.404244:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136834560 00000100:00100000:2.0:1788592740.404272:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136834560 00000100:00100000:2.0:1788592740.404550:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 129 00000100:00100000:2.0:1788592740.404565:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+20:10551:x1875475136834560:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592740.404601:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592740.404629:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b7e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404721:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404739:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404752:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404767:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404774:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.404781:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.405580:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.405599:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.405611:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.405670:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.405687:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 21 pid: 5824 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.405705:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147329024:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592740.406007:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981862b7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788592740.409766:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592740.412212:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147329024:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592740.412257:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592740.412593:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136834816 00000100:00100000:0.0:1788592740.412604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136834816 00000100:00100000:0.0:1788592740.412786:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:0.0:1788592740.412798:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+22:5582:x1875475136834816:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788592740.413305:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+23:5582:x1875475136834816:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 507us (3552us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788592740.413315:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1788592740.415826:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592740.419270:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136834944 00000100:00100000:3.0:1788592740.419295:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136834944 00010000:00010000:2.0:1788592740.419628:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 23 pid: 5824 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592740.419694:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:2.0:1788592740.419709:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:2343:x1875475136834944:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592740.419753:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592740.419763:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 23 pid: 5824 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419778:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 23 pid: 5824 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419809:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f1325111fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b3f expref: 23 pid: 5824 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419833:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592740.419839:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419853:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419863:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592740.419912:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592740.420007:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:2343:x1875475136834944:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 301us (4199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592740.420015:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00010000:00010000:3.0:1788592740.422676:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422730:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592740.422798:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788592740.422804:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592740.422833:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422852:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422865:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422872:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422880:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422886:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592740.422890:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422899:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422918:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:3.0:1788592740.422921:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592740.422927:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422942:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325112e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422961:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422969:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422975:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422979:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592740.422982:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422989:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.422997:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8981a1fe1300) 00010000:00010000:3.0:1788592740.423000:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592740.423003:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.423009:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f1325112eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.423062:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325112dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b7e expref: 22 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.423079:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b7e expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592740.423095:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592740.423098:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592740.423101:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5800, rc 0) 00000100:00100000:3.0:1788592740.423204:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10551:x1875475136834560:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 18641us (21178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592740.423214:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 129 00010000:00010000:1.0:1788592740.607521:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788592741.376728:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592741.376741:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592741.376799:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788592741.376808:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592741.376981:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaa9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147329152:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788592741.382427:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592741.388210:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592741.388333:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaa9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147329152:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592741.388878:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136835072 00000100:00100000:2.0:1788592741.388888:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136835072 00000100:00100000:2.0:1788592741.388947:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 130 00000100:00100000:2.0:1788592741.388958:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10562:x1875475136835072:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592741.389020:0:6700:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592741.389166:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10562:x1875475136835072:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 208us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592741.389175:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 130 00000040:00080000:1.0:1788592741.391986:0:12039:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592741.392003:0:12039:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592741.392072:0:12039:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788592741.392078:0:12039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592741.398960:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592741.399044:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136835328 00000100:00100000:2.0:1788592741.399778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136835328 00000100:00100000:2.0:1788592741.399863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:2.0:1788592741.399875:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:10562:x1875475136835328:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592741.399904:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592741.399933:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f1325112f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b85 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.401225:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.401253:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.401272:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592741.401294:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788592741.401602:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f1325112f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b85 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.401622:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b85 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.401663:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592741.401666:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592741.401671:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:2.0:1788592741.404083:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:10562:x1875475136835328:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4191us (5119us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788592741.404099:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 131 00000100:00100000:3.0:1788592741.416467:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592741.416692:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136835584 00000100:00100000:2.0:1788592741.416705:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136835584 00000100:00100000:2.0:1788592741.416783:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 132 00000100:00100000:2.0:1788592741.416794:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+23:10562:x1875475136835584:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788592741.416911:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.416935:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.416951:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417627:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417651:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417659:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417681:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592741.417686:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417696:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417713:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:2.0:1788592741.417716:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592741.417723:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592741.417730:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251130e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592741.417938:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+24:10562:x1875475136835584:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 1143us (1493us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788592741.417949:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 132 00000040:00080000:1.0:1788592741.418301:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592741.418307:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592741.419010:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788592741.419022:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592741.433546:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592741.436746:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136835840 00000100:00100000:1.0:1788592741.436770:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136835840 00000100:00100000:1.0:1788592741.436867:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1788592741.436882:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:10562:x1875475136835840:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592741.438985:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:10562:x1875475136835840:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 2090us (5431us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788592741.439002:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:0.0:1788592741.442099:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592741.442183:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136835968 00000100:00100000:1.0:1788592741.442197:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136835968 00000100:00100000:1.0:1788592741.442290:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592741.442305:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+25:2342:x1875475136835968:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592741.442326:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592741.442400:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b85 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592741.442462:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592741.442470:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592741.442550:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+24:2342:x1875475136835968:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 248us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592741.442559:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00010000:00010000:2.0:1788592741.636998:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592742.655204:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592743.464023:0:12090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592743.464041:0:12090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592743.464103:0:12090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788592743.464111:0:12090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788592743.681202:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592743.735277:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592743.735453:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836224 00000100:00100000:3.0:1788592743.735466:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836224 00000100:00100000:3.0:1788592743.735558:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00100000:3.0:1788592743.735572:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+24:10583:x1875475136836224:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592743.735619:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592743.735651:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b8c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.735783:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251131c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.735814:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251131c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.735829:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251131c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592743.735844:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788592743.736003:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b8c expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.736029:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251131c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b8c expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.736038:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592743.736040:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788592743.736046:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4600, rc 0) 00000100:00100000:3.0:1788592743.736125:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+26:10583:x1875475136836224:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 557us (865us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788592743.736134:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 133 00000100:00080000:2.0:1788592743.736580:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592743.744087:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592743.745663:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836352 00000100:00100000:3.0:1788592743.745686:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836352 00000100:00100000:3.0:1788592743.745779:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:3.0:1788592743.745792:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:10583:x1875475136836352:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1788592743.745896:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.745918:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.745945:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.745980:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.745989:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.745997:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.746004:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592743.746010:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.746018:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.746033:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:3.0:1788592743.746036:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592743.746042:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.746049:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5800/0x27b316f13251132a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592743.746157:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:10583:x1875475136836352:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 367us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592743.746165:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 134 00000100:00100000:0.0:1788592743.912115:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592743.912949:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836480 00000100:00100000:3.0:1788592743.912979:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836480 00000100:00100000:3.0:1788592743.913066:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:3.0:1788592743.913078:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136836480:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1788592743.913102:0:8688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592743.913127:0:8688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013366918/0x27b316f132511331 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b93 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592743.913164:0:8688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bc262, atime: 0x6a9bc261, ctime: 0x6a9bc262, blocks: 0xb 00010000:00010000:3.0:1788592743.913201:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1788592743.913206:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592743.913218:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013366918/0x27b316f132511331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b93 expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.913244:0:8688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013366918/0x27b316f132511331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b93 expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592743.913260:0:8688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5800, rc 0) 00000100:00100000:3.0:1788592743.913328:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136836480:12345-192.168.204.20@tcp:101:cat.0 Request processed in 252us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592743.913336:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00080000:2.0:1788592743.913612:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592743.918148:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592743.918248:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836608 00000100:00100000:2.0:1788592743.918279:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836608 00002000:00100000:2.0:1788592743.918341:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff898085893800 x1875475136836608/t0(0) o3->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:19/0 lens 488/0 e 0 to 0 dl 1788592754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592743.918385:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898085893800 with x1875475136836608 ext(0->4095) 00002000:00010000:2.0:1788592743.918393:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898085893800 00000100:00100000:2.0:1788592743.918424:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1788592743.918446:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136836608:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:2.0:1788592743.918731:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136836608:12345-192.168.204.20@tcp:3:cat.0 Request processed in 296us (596us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788592743.918739:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:2.0:1788592743.918745:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff898085893800 x1875475136836608/t0(0) o3->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:19/0 lens 488/4536 e 0 to 0 dl 1788592754 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592743.918753:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898085893800 with x1875475136836608 ext(0->4095) 00002000:00010000:2.0:1788592743.918757:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898085893800 00000100:00100000:2.0:1788592744.190671:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147329280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592744.190778:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592744.191116:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147329536:0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.191154:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592744.191177:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592744.191183:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147329664:0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.191207:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592744.191241:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329536 00000100:00100000:2.0:1788592744.191251:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329536 00000100:00100000:2.0:1788592744.191304:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329664 00000100:00100000:2.0:1788592744.191308:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329664 00000100:00100000:2.0:1788592744.191393:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592744.191404:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147329536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.191469:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147329536:12345-0@lo:400:kworker.0 Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592744.191477:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788592744.191497:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788592744.191503:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147329664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.191530:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147329664:12345-0@lo:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592744.191536:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788592744.191556:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592744.191603:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc816a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147329664:0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.191616:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147329536:0@lo:400:kworker.0 00000100:00100000:3.0:1788592744.191972:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147329792:0@lo:400:kworker.0 00000100:00100000:3.0:1788592744.192015:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592744.192046:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592744.192053:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147329408:0@lo:400:kworker.0 00000100:00100000:3.0:1788592744.192081:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592744.192105:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147329920:0@lo:400:kworker.0 00000100:00100000:3.0:1788592744.192142:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592744.192175:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329920 00000100:00100000:3.0:1788592744.192179:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329920 00000100:00100000:3.0:1788592744.192219:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592744.192227:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147329920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592744.192265:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147329920:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.192272:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788592744.192302:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788592744.192308:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1788592744.192327:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff898183e99500, transno 4294967301 00000004:00080000:3.0:1788592744.192338:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1788592744.192388:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bcaab480, transno 4294967304 00000100:00100000:3.0:1788592744.192395:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147329920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592744.193008:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329280 00000100:00100000:1.0:1788592744.193015:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329280 00000100:00100000:1.0:1788592744.193062:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788592744.193071:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875475147329280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592744.193105:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592744.193168:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875475147329280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592744.193175:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788592744.193201:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329792 00000100:00100000:1.0:1788592744.193204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329792 00000100:00100000:1.0:1788592744.193233:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788592744.193239:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147329792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592744.193271:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147329792:12345-0@lo:400:kworker.0 Request processed in 32us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592744.193277:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788592744.193310:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147329792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592744.193332:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147329280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592744.193828:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147330048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592744.193896:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592744.194047:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330048 00000100:00100000:3.0:1788592744.194053:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330048 00000100:00100000:3.0:1788592744.194089:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788592744.194098:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147330048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592744.194122:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592744.194157:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147330048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592744.194164:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592744.194241:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147329408 00000100:00100000:2.0:1788592744.194247:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147329408 00000100:00100000:2.0:1788592744.194289:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788592744.194297:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147329408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592744.194338:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147329408:12345-0@lo:400:kworker.0 Request processed in 41us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592744.194345:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:2.0:1788592744.194407:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592744.194413:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592744.194414:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592744.194577:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147330048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592744.194956:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147329408:0@lo:400:kworker.0 00010000:00010000:1.0:1788592744.702844:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788592745.325864:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788592745.325916:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788592745.364588:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000020:00080000:3.0:1788592745.364610:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8981905dbc00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788592745.364617:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc951300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8981905db0c0 00000020:00080000:3.0:1788592745.364637:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc951600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc5c8800 00000001:00080000:3.0:1788592745.364661:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1788592745.364700:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788592745.364709:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788592745.364856:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788592745.365094:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788592745.451852:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592745.451966:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592745.452005:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592745.452024:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592745.452052:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592745.452086:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837248 00000100:00100000:2.0:1788592745.452099:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837248 00000100:00100000:2.0:1788592745.452246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836864 00000100:00100000:2.0:1788592745.452250:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836864 00000100:00100000:2.0:1788592745.452280:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:2.0:1788592745.452292:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136837248:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592745.452689:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836992 00000100:00100000:3.0:1788592745.452696:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836992 00000100:00100000:3.0:1788592745.452731:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837120 00000100:00100000:3.0:1788592745.452735:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837120 00000100:00100000:3.0:1788592745.452759:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592745.452768:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136836992:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592745.452881:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136837248:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 590us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592745.452890:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:2.0:1788592745.452915:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:2.0:1788592745.452923:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2341:x1875475136836864:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592745.453002:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136836736 00000100:00100000:1.0:1788592745.453007:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136836736 00000100:00100000:1.0:1788592745.453038:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 294 00000100:00100000:1.0:1788592745.453046:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136836736:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592745.453259:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2341:x1875475136836992:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 491us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592745.453268:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592745.453283:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1788592745.453290:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136837120:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592745.453318:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136837120:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592745.453324:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:2.0:1788592745.457796:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2341:x1875475136836864:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 4857us (5754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592745.457817:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00080000:2.0:1788592745.457878:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592745.457884:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592745.457888:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592745.464384:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136836736:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 11295us (12506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592745.464403:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 294 00010000:00010000:0.0:1788592745.740947:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592746.751178:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788592747.594342:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592747.594438:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592747.594487:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788592747.594494:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788592747.790129:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592748.803501:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592749.318185:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147330304:0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.318227:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147330688:0@lo:400:kworker.0 00000100:00100000:1.0:1788592749.321267:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147330432:0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.332981:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592749.333079:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147330176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592749.333137:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592749.333160:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147330816:0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.333189:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592749.333241:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147330560:0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.333267:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592749.333304:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147331072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592749.333334:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592749.333388:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330176 00000100:00100000:0.0:1788592749.333398:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330176 00000100:00100000:0.0:1788592749.333457:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331072 00000100:00100000:0.0:1788592749.333460:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331072 00000100:00100000:0.0:1788592749.333479:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788592749.333498:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147330176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788592749.333548:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592749.333600:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147330176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592749.333607:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788592749.333638:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788592749.333661:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147331072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592749.333682:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592749.333715:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147331072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592749.333721:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788592749.333950:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330816 00000100:00100000:0.0:1788592749.333954:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330816 00000100:00100000:0.0:1788592749.333983:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330560 00000100:00100000:0.0:1788592749.333986:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330560 00000100:00100000:0.0:1788592749.334006:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788592749.334012:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147330816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.334046:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147330816:12345-0@lo:400:kworker.0 Request processed in 34us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592749.334052:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788592749.334064:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788592749.334070:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147330560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.334096:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147330560:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592749.334101:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1788592749.334124:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592749.334128:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592749.334130:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592749.334167:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147330560:0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.334179:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788592749.334186:0:3284:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bca9df80, transno 4294967310 00000004:00080000:0.0:1788592749.334199:0:3284:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788592749.334235:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147331072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592749.334742:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147330176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592749.334755:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147330816:0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.339456:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592749.339734:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330304 00000100:00100000:3.0:1788592749.339746:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330304 00000100:00100000:3.0:1788592749.339801:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788592749.339813:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147330304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.339920:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147330304:12345-0@lo:400:kworker.0 Request processed in 108us (6950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592749.339944:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788592749.340005:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330688 00000100:00100000:3.0:1788592749.340009:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330688 00000100:00100000:3.0:1788592749.340038:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788592749.340045:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147330688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.340086:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147330688:12345-0@lo:400:kworker.0 Request processed in 42us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592749.340093:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788592749.340141:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147330688:0@lo:400:kworker.0 00000100:00100000:0.0:1788592749.341090:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147330304:0@lo:400:kworker.0 00000100:00100000:1.0:1788592749.342922:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592749.343001:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147330944:0@lo:400:kworker.0 00000100:00100000:1.0:1788592749.343049:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592749.343117:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330944 00000100:00100000:1.0:1788592749.343125:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330944 00000100:00100000:1.0:1788592749.343176:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592749.343185:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147330944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592749.343245:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147330944:12345-0@lo:400:kworker.0 Request processed in 61us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592749.343252:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788592749.343543:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147330944:0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.344492:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147330432 00000100:00100000:3.0:1788592749.344503:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147330432 00000100:00100000:3.0:1788592749.344567:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788592749.344577:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147330432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592749.344754:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147330432:12345-0@lo:400:kworker.0 Request processed in 178us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592749.344762:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788592749.344842:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147330432:0@lo:400:kworker.0 00010000:00010000:0.0:1788592749.822718:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592749.976851:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592749.977039:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837376 00000100:00100000:2.0:1788592749.977052:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837376 00000100:00100000:2.0:1788592749.977143:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00100000:2.0:1788592749.977156:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10236:x1875475136837376:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788592749.977304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10236:x1875475136837376:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 150us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592749.977332:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 135 00000100:00080000:0.0:1788592749.977563:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592749.988853:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592749.989051:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837632 00000100:00100000:1.0:1788592749.989064:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837632 00000100:00100000:1.0:1788592749.989146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:1.0:1788592749.989157:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:10236:x1875475136837632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592749.989620:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:10236:x1875475136837632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 463us (790us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788592749.989640:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000001:00080000:2.0:1788592750.461015:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788592750.461034:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788592750.461188:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788592750.461206:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788592750.469508:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592750.469627:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837760 00000100:00100000:0.0:1788592750.469640:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837760 00000100:00100000:0.0:1788592750.469728:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00100000:0.0:1788592750.469740:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:11036:x1875475136837760:12345-192.168.204.20@tcp:101:lsof.0 00010000:00010000:0.0:1788592750.469768:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592750.469797:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1b9a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.469879:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.469898:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.469915:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592750.469955:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592750.469958:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592750.470003:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.470047:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.470147:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592750.470158:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592750.470161:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592750.470166:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592750.470245:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:11036:x1875475136837760:12345-192.168.204.20@tcp:101:lsof.0 Request processed in 507us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592750.470252:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 136 00000100:00080000:2.0:1788592750.471136:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592750.564870:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592750.565116:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136837888 00000100:00100000:1.0:1788592750.565130:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136837888 00000100:00100000:1.0:1788592750.565192:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 296 00000100:00100000:1.0:1788592750.565202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136837888:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592750.565297:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136837888:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592750.565305:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 296 00000100:00100000:2.0:1788592750.565625:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592750.565769:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592750.565922:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838144 00000100:00100000:3.0:1788592750.565928:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838144 00000100:00100000:3.0:1788592750.565981:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838016 00000100:00100000:3.0:1788592750.565984:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838016 00000100:00100000:3.0:1788592750.566005:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1788592750.566013:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136838144:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592750.566056:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136838144:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592750.566064:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1788592750.566094:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1788592750.566100:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136838016:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592750.566124:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2342:x1875475136838016:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592750.566130:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00080000:2.0:1788592750.566658:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592750.566664:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788592750.848321:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592751.876108:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592752.894679:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592753.919508:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592754.425266:0:12293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:19:12 (1788592752) 00000100:00100000:1.0:1788592754.451206:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147331328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592754.451303:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.453731:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147331200:0@lo:400:kworker.0 00000100:00100000:3.0:1788592754.453843:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592754.454475:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981886f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592754.454557:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592754.454632:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331328 00000100:00100000:2.0:1788592754.454642:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331328 00000100:00100000:2.0:1788592754.454704:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331456 00000100:00100000:2.0:1788592754.454707:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331456 00000100:00100000:2.0:1788592754.454726:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592754.454734:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147331328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592754.454773:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592754.455602:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331200 00000100:00100000:3.0:1788592754.455616:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331200 00000100:00100000:3.0:1788592754.455679:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788592754.455690:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147331200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592754.455772:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147331200:12345-0@lo:400:kworker.0 Request processed in 84us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592754.455780:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788592754.455840:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147331200:0@lo:400:kworker.0 00000100:00100000:1.0:1788592754.456818:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147331840:0@lo:400:kworker.0 00000100:00100000:3.0:1788592754.456901:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147331584:0@lo:400:kworker.0 00000100:00100000:1.0:1788592754.456902:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.458498:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147331712:0@lo:400:kworker.0 00000100:00100000:3.0:1788592754.458574:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592754.460188:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788592754.460225:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147331456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592754.460289:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592754.460408:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147331456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (5850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592754.460416:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788592754.460467:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592754.460473:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592754.462612:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331840 00000100:00100000:0.0:1788592754.462630:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331840 00000100:00100000:0.0:1788592754.462701:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331712 00000100:00100000:0.0:1788592754.462704:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331712 00000100:00100000:0.0:1788592754.462738:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788592754.463695:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147331328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8948us (12379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592754.463711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592754.463811:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981886f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147331456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788592754.464369:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147331840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592754.464503:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147331840:12345-0@lo:400:kworker.0 Request processed in 1756us (7604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.464513:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788592754.464549:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788592754.464559:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147331712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592754.464617:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147331712:12345-0@lo:400:kworker.0 Request processed in 61us (6044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.464623:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788592754.464698:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592754.464842:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147331712:0@lo:400:kworker.0 00000100:00080000:2.0:1788592754.466814:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592754.467491:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147331584 00000100:00100000:0.0:1788592754.467510:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147331584 00000100:00100000:0.0:1788592754.467595:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788592754.467610:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147331584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592754.468053:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147331584:12345-0@lo:400:kworker.0 Request processed in 139us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592754.468063:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788592754.468338:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147331584:0@lo:400:kworker.0 00000100:00100000:1.0:1788592754.469847:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147331328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592754.469905:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147331840:0@lo:400:kworker.0 00010000:00010000:1.0:1788592754.942667:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592755.700549:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592755.700613:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592755.700669:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592755.700702:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592755.700742:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592755.700951:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838528 00000100:00100000:0.0:1788592755.700966:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838528 00000100:00100000:0.0:1788592755.701054:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838656 00000100:00100000:0.0:1788592755.701058:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838656 00000100:00100000:0.0:1788592755.701085:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:0.0:1788592755.701097:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136838528:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592755.701120:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838272 00000100:00100000:3.0:1788592755.701126:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838272 00000100:00100000:3.0:1788592755.701166:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:3.0:1788592755.701175:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136838272:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592755.701207:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136838528:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 112us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.701216:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1788592755.701224:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136838272:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592755.701232:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:0.0:1788592755.701240:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1788592755.701250:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136838656:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592755.701281:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838784 00000100:00100000:0.0:1788592755.701281:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136838656:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 32us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592755.701287:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838784 00000100:00100000:0.0:1788592755.701305:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1788592755.701329:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136838400 00000100:00100000:3.0:1788592755.701333:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136838400 00000100:00100000:0.0:1788592755.701341:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:0.0:1788592755.701394:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2344:x1875475136838784:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592755.701401:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:3.0:1788592755.701412:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2344:x1875475136838400:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:0.0:1788592755.701438:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2344:x1875475136838784:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 88us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592755.701444:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:3.0:1788592755.701457:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2344:x1875475136838400:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 47us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592755.701467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00080000:2.0:1788592755.701996:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788592755.702002:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788592755.702004:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788592755.966648:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592756.648699:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592756.648849:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839040 00000100:00100000:1.0:1788592756.648863:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839040 00000100:00100000:1.0:1788592756.648953:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:1.0:1788592756.648966:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:11300:x1875475136839040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592756.648994:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592756.649021:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132511346 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ba1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649116:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649135:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649149:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649168:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649175:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649181:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649727:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251135b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649750:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251135b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649758:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251135b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592756.649769:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788592756.649960:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649969:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649976:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649982:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592756.649986:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.649994:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650009:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff898185c2db00) 00010000:00010000:1.0:1788592756.650012:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592756.650017:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650023:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f13251134d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650035:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650047:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650053:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650058:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592756.650061:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650068:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650075:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89818289a200) 00010000:00010000:1.0:1788592756.650077:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592756.650080:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.650086:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f132511354 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.654976:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132511346 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ba1 expref: 16 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.655014:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251135b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ba1 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592756.655026:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:1.0:1788592756.655029:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592756.655045:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf600, rc 0) 00000100:00100000:1.0:1788592756.655143:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11300:x1875475136839040:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 6177us (6457us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788592756.655154:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 137 00000100:00100000:3.0:1788592756.668148:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592756.668276:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839168 00000100:00100000:0.0:1788592756.668289:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839168 00000100:00100000:0.0:1788592756.668400:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:0.0:1788592756.668412:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11300:x1875475136839168:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788592756.668552:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11300:x1875475136839168:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592756.668561:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 138 00000100:00100000:3.0:1788592756.679571:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592756.679994:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839296 00000100:00100000:0.0:1788592756.680008:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839296 00000100:00100000:0.0:1788592756.680100:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1788592756.680113:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:2343:x1875475136839296:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592756.680135:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592756.680170:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251135b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ba1 expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592756.680208:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:0.0:1788592756.680216:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592756.680301:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:2343:x1875475136839296:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 191us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592756.680653:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000040:00080000:0.0:1788592756.798795:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592756.798810:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592756.799406:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788592756.799418:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788592756.990805:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592757.832239:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592757.832251:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592757.832925:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1788592757.832933:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788592758.016726:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592759.022309:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.022689:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839424 00000100:00100000:2.0:1788592759.022702:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839424 00000100:00100000:2.0:1788592759.022783:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:2.0:1788592759.022795:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+14:11343:x1875475136839424:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592759.022817:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788592759.022825:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788592759.022841:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ba8 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022914:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022929:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022943:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022959:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022966:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.022985:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023235:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023244:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023250:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023256:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.023261:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023268:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023280:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:2.0:1788592759.023283:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.023288:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023293:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511370 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023946:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023952:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023957:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023971:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.023974:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023981:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.023990:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8981a1fe1000) 00010000:00010000:2.0:1788592759.023993:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.023996:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.024003:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511377 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.024197:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511369 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ba8 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.024208:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:2.0:1788592759.024211:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.024216:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ba8 expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.024227:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4000, rc 0) 00000100:00100000:2.0:1788592759.024315:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+14:11343:x1875475136839424:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1522us (2030us total) trans 0 rc 301/301 00000100:00100000:2.0:1788592759.024332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 139 00000100:00100000:3.0:1788592759.028965:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.029027:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839680 00000100:00100000:1.0:1788592759.029051:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839680 00000100:00100000:1.0:1788592759.029123:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00100000:1.0:1788592759.029136:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981886f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+14:11343:x1875475136839680:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:1.0:1788592759.029203:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592759.029235:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132510ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.029256:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:1.0:1788592759.029261:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592759.029674:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.029691:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.029701:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.029736:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 5 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.029751:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 5 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592759.029781:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147331968:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592759.029883:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981977093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592759.037420:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147331968:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592759.037461:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042033:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592759.042250:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592759.042524:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839808 00000100:00100000:0.0:1788592759.042535:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839808 00010000:00010000:0.0:1788592759.042596:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 6 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.042639:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:0.0:1788592759.042651:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2344:x1875475136839808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592759.042666:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592759.042674:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 6 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042690:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 6 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042712:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251133f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b9a expref: 6 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042739:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592759.042745:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042753:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042762:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042789:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592759.042843:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2344:x1875475136839808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 195us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.042851:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00010000:00010000:0.0:1788592759.042938:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042947:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042975:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042986:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.042994:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592759.044134:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788592759.044156:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044167:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044175:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044182:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592759.044188:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044196:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044210:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592759.044214:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592759.044219:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.044226:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f13251137e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592759.044244:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d1b34e reply state 00000000c8be96fd transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.044253:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592759.044394:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981886f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11343:x1875475136839680:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 15257us (15437us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788592759.044404:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 140 00000100:00080000:2.0:1788592759.045288:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592759.049890:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049919:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049944:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049950:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592759.049956:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049964:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049980:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff898185c2d600) 00010000:00010000:3.0:1788592759.049983:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592759.049988:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.049993:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f132511385 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.208536:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.208740:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136839936 00000100:00100000:1.0:1788592759.208752:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136839936 00000100:00100000:1.0:1788592759.209205:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:1.0:1788592759.209218:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+14:11351:x1875475136839936:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:1.0:1788592759.209243:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592759.209268:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251138c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1baf expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209382:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209398:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209410:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592759.209448:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592759.209452:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592759.209477:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209510:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251138c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1baf expref: 16 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209529:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1baf expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.209537:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:1.0:1788592759.209540:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592759.209544:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be200, rc 0) 00000100:00100000:1.0:1788592759.209665:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11351:x1875475136839936:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 449us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.209674:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 141 00000100:00100000:1.0:1788592759.287511:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.287912:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840064 00000100:00100000:3.0:1788592759.287927:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840064 00000100:00100000:3.0:1788592759.287996:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:3.0:1788592759.288007:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+15:11357:x1875475136840064:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1788592759.288030:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592759.288064:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251139a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bb6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288138:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288170:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288182:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288197:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288203:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288209:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288609:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288618:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288625:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592759.288654:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788592759.288657:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592759.288675:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288687:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288702:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288709:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288714:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592759.288719:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288726:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288737:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:3.0:1788592759.288851:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592759.288857:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288863:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288878:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288884:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288889:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288894:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592759.288903:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288909:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288916:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8981898bf900) 00010000:00010000:3.0:1788592759.288918:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592759.288921:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288926:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288959:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251139a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bb6 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288971:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bb6 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.288978:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592759.288980:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788592759.288983:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4a00, rc 0) 00000100:00100000:2.0:1788592759.294865:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+16:11357:x1875475136840064:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6848us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.294879:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 142 00000100:00100000:0.0:1788592759.317500:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.317878:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840320 00000100:00100000:1.0:1788592759.317899:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840320 00000100:00100000:1.0:1788592759.318543:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 143 00000100:00100000:1.0:1788592759.318559:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+16:11357:x1875475136840320:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592759.318583:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592759.318611:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f1325113b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bbd expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.318762:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.318790:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.318825:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.319415:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.319438:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.319451:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592759.320442:0:6700:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788592759.320795:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320809:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320819:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320862:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320870:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320877:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320884:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592759.320897:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320906:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320922:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592759.320925:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592759.320931:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.320938:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325113bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592759.320953:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000107c9b70 reply state 00000000edb9839f transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592759.320962:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788592759.322662:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f1325113b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 19 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.322696:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 18 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.322705:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:1.0:1788592759.322708:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592759.322711:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf200, rc 0) 00000100:00100000:1.0:1788592759.322802:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11357:x1875475136840320:12345-192.168.204.20@tcp:101:bash.0 Request processed in 4246us (5313us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788592759.322812:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 143 00010000:00010000:3.0:1788592759.330456:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330474:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330483:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330519:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592759.330525:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330532:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330550:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89818289a700) 00010000:00010000:3.0:1788592759.330553:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592759.330557:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.330563:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325113c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.335706:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592759.335757:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840448 00000100:00100000:0.0:1788592759.335767:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840448 00000100:00100000:0.0:1788592759.335840:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1788592759.335853:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136840448:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592759.335872:0:8688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592759.335900:0:8688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bc4 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592759.335929:0:8688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788592759.335949:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:0.0:1788592759.335954:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592759.335963:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 6 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.335986:0:8688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 6 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.335999:0:8688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb200, rc 0) 00000100:00080000:3.0:1788592759.336004:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592759.336058:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136840448:12345-192.168.204.20@tcp:101:bash.0 Request processed in 208us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.336066:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1788592759.345491:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.345712:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840576 00000100:00100000:3.0:1788592759.345724:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840576 00000100:00100000:3.0:1788592759.345797:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:3.0:1788592759.345809:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:11357:x1875475136840576:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1788592759.345830:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592759.345851:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bcb expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.345889:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.345899:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592759.345921:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592759.345928:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.346331:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.346368:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592759.346385:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bcaab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147332096:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592759.346830:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592759.352260:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bcaab480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875475147332096:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592759.352330:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.352379:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:1.0:1788592759.352486:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:11357:x1875475136840576:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6679us (7009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.352498:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1788592759.353701:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.354702:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840704 00000100:00100000:2.0:1788592759.354717:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840704 00010000:00010000:2.0:1788592759.354778:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592759.354837:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:2.0:1788592759.354850:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136840704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592759.354873:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592759.354902:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.354922:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.354961:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dee3afaa/0x27b316f1325113d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bc4 expref: 7 pid: 8688 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.354987:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592759.354993:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592759.355006:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.355019:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.355086:0:11159:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592759.355102:0:11159:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11159:1875475147332224:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592759.355223:0:11159:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592759.367409:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.368264:0:11159:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11159:1875475147332224:192.168.204.20@tcp:105: 00010000:00010000:2.0:1788592759.368298:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592759.368390:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136840704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 13539us (14701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.368402:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1788592759.368595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136840960 00000100:00100000:3.0:1788592759.368605:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136840960 00000100:00100000:3.0:1788592759.368662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1788592759.368672:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11357:x1875475136840960:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1788592759.369016:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11357:x1875475136840960:12345-192.168.204.20@tcp:35:bash.0 Request processed in 345us (1617us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788592759.369024:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1788592759.473326:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592759.474466:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136841216 00000100:00100000:0.0:1788592759.474481:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136841216 00000100:00100000:0.0:1788592759.474581:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1788592759.474592:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11367:x1875475136841216:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592759.474633:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592759.474659:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325113e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bd2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592759.474760:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788592759.474895:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325113e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bd2 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.474910:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:0.0:1788592759.474913:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592759.474920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325113e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bd2 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.475135:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592759.475263:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11367:x1875475136841216:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 672us (1947us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788592759.475272:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 144 00000100:00100000:0.0:1788592759.488153:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.488260:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136841472 00000100:00100000:3.0:1788592759.488271:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136841472 00000100:00100000:3.0:1788592759.488336:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1788592759.488380:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11367:x1875475136841472:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592759.488650:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:11367:x1875475136841472:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 303us (507us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788592759.488676:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:2.0:1788592759.552596:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147332352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592759.552684:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592759.552833:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332352 00000100:00100000:3.0:1788592759.552843:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332352 00000100:00100000:3.0:1788592759.552916:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788592759.552926:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147332352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592759.552967:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592759.553021:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147332352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592759.553028:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788592759.553102:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592759.553142:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147332352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592759.554413:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592759.554429:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147332480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592759.554481:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592759.554545:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147332608:0@lo:400:kworker.0 00000100:00100000:3.0:1788592759.554576:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592759.554591:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147332736:0@lo:400:kworker.0 00000100:00100000:2.0:1788592759.554629:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147332864:0@lo:400:kworker.0 00000100:00100000:1.0:1788592759.554646:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592759.554692:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592759.554723:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332736 00000100:00100000:1.0:1788592759.554729:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332736 00000100:00100000:1.0:1788592759.554779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332864 00000100:00100000:1.0:1788592759.554782:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332864 00000100:00100000:2.0:1788592759.554813:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592759.554825:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147332736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592759.554876:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147332736:12345-0@lo:400:kworker.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.554903:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788592759.554927:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788592759.554933:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147332864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592759.554967:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147332864:12345-0@lo:400:kworker.0 Request processed in 34us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.554973:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788592759.558735:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332480 00000100:00100000:0.0:1788592759.558746:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332480 00000100:00100000:0.0:1788592759.558819:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788592759.558830:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147332480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592759.558866:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592759.558948:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147332480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.558974:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788592759.559009:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147332992:0@lo:400:kworker.0 00000100:00100000:0.0:1788592759.559048:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592759.559221:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba577100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147332736:0@lo:400:kworker.0 00000100:00100000:3.0:1788592759.559266:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147332864:0@lo:400:kworker.0 00000100:00100000:3.0:1788592759.559297:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147332480:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788592759.559337:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592759.559342:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592759.562509:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332992 00000100:00100000:3.0:1788592759.562529:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332992 00000100:00100000:0.0:1788592759.562614:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147332608 00000100:00100000:3.0:1788592759.562622:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788592759.562635:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147332992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592759.562670:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147332608 00000100:00100000:0.0:1788592759.562709:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788592759.562718:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147332608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592759.562729:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1875475147332992:12345-0@lo:400:kworker.0 Request processed in 97us (3679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592759.562739:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788592759.562768:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147332608:12345-0@lo:400:kworker.0 Request processed in 52us (8191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.562776:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788592759.562835:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147332608:0@lo:400:kworker.0 00000100:00100000:0.0:1788592759.562873:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3284:1875475147332992:0@lo:400:kworker.0 00000100:00080000:2.0:1788592759.563909:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592759.587515:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.591151:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136841600 00000100:00100000:3.0:1788592759.591190:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136841600 00000100:00100000:3.0:1788592759.591282:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:3.0:1788592759.591303:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+21:11373:x1875475136841600:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592759.591757:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592759.592010:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bd9 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592092:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592106:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592118:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592759.592166:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788592759.592170:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592759.592191:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592219:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325113f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bd9 expref: 23 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592240:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bd9 expref: 22 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.592248:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592759.592250:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592759.592254:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4400, rc 0) 00000100:00100000:2.0:1788592759.597939:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11373:x1875475136841600:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 6617us (10412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.597952:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 145 00000100:00100000:0.0:1788592759.618035:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.618147:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136841856 00000100:00100000:2.0:1788592759.618159:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136841856 00000100:00100000:2.0:1788592759.618232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:2.0:1788592759.618243:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11373:x1875475136841856:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592759.618263:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592759.618297:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511403 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1be0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.618702:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251140a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.618719:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251140a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.618731:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251140a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592759.618744:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788592759.618898:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511403 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be0 expref: 25 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.618919:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251140a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be0 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.618926:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:2.0:1788592759.618930:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592759.618934:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:2.0:1788592759.620056:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11373:x1875475136841856:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1808us (2025us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788592759.620070:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 146 00000100:00100000:0.0:1788592759.628041:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592759.628093:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.628300:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136842240 00000100:00100000:3.0:1788592759.628313:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136842240 00000100:00100000:3.0:1788592759.628461:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:3.0:1788592759.628473:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11373:x1875475136842240:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592759.628498:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592759.628530:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511418 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1be7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592759.628553:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136841984 00000100:00100000:1.0:1788592759.628560:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136841984 00000100:00100000:1.0:1788592759.628611:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1788592759.628619:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+26:2342:x1875475136841984:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592759.628629:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592759.628650:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251140a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be0 expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.628669:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:1.0:1788592759.628674:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592759.628741:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+25:2342:x1875475136841984:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 122us (710us total) trans 0 rc 0/0 00010000:00010000:3.0:1788592759.628763:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.628779:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.628789:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592759.628801:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:1.0:1788592759.628872:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00010000:00010000:3.0:1788592759.628940:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be7 expref: 26 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.628955:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be7 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.628963:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:3.0:1788592759.628965:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788592759.628968:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5000, rc 0) 00000100:00100000:3.0:1788592759.628995:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11373:x1875475136842240:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 525us (901us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788592759.629012:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 147 00000100:00100000:1.0:1788592759.635560:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.635923:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136842368 00000100:00100000:3.0:1788592759.635935:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136842368 00000100:00100000:3.0:1788592759.636003:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1788592759.636015:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136842368:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:3.0:1788592759.636063:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.636085:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.636094:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592759.636098:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592759.636102:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.636140:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.636155:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 6 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592759.636170:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875475147333120:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592759.636270:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592759.640104:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.640623:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875475147333120:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592759.640670:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592759.643329:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136842496 00000100:00100000:2.0:1788592759.643586:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136842496 00002000:00100000:2.0:1788592759.643658:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8981bca9f800 x1875475136842496/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:35/0 lens 504/0 e 0 to 0 dl 1788592770 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592759.643670:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bca9f800 with x1875475136842496 ext(0->12) 00010000:00010000:2.0:1788592759.643969:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 7 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.643990:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 7 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592759.643999:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bca9f800 00000100:00100000:2.0:1788592759.644111:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1788592759.644124:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136842496:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:2.0:1788592759.644742:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136842496:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 620us (4646us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788592759.644755:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00002000:00100000:2.0:1788592759.644764:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8981bca9f800 x1875475136842496/t4294967305(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:35/0 lens 504/448 e 0 to 0 dl 1788592770 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788592759.644774:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bca9f800 with x1875475136842496 ext(0->12) 00010000:00010000:2.0:1788592759.644781:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.644795:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592759.644802:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bca9f800 00000100:00100000:0.0:1788592759.651661:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.651996:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136842624 00000100:00100000:1.0:1788592759.652007:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136842624 00010000:00010000:1.0:1788592759.652054:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592759.652108:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1788592759.652119:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2344:x1875475136842624:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592759.654639:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788592759.654671:0:5808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788592759.655735:0:5808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788592758 00002000:00010000:1.0:1788592759.655739:0:5808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788592758 00002000:00010000:1.0:1788592759.655742:0:5808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788592758 00010000:00010000:1.0:1788592759.655757:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.655778:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.655804:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011355d5b/0x27b316f1325113e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bcb expref: 9 pid: 6676 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.655822:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592759.655827:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592759.655853:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.655864:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.656071:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592759.656156:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136842624:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 4037us (4504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.656168:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00010000:00010000:3.0:1788592759.658194:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658212:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658251:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658260:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658268:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658275:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592759.658279:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658298:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658317:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.658342:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000599ec5b1/0x27b316f13251142d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592759.658622:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136842368:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 22606us (23070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592759.658633:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1788592759.662433:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592759.662659:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136842880 00000100:00100000:3.0:1788592759.662670:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136842880 00000100:00100000:3.0:1788592759.662734:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:3.0:1788592759.662745:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11373:x1875475136842880:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:3.0:1788592759.662997:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be7 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592759.663298:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788592759.663343:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788592759.664242:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788592759.664315:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.664333:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 29 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592759.664344:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.665136:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 29 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.665159:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 29 pid: 6700 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.665176:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147333248:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592759.665338:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081600 going to sleep for 11 seconds 00000100:00100000:1.0:1788592759.669508:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.670213:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136843008 00000100:00100000:2.0:1788592759.670224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136843008 00010000:00010000:2.0:1788592759.670275:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 30 pid: 6700 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592759.670342:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:2.0:1788592759.670384:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+30:2343:x1875475136843008:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592759.670400:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592759.670408:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 30 pid: 6700 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.670423:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 30 pid: 6700 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.670446:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:2.0:1788592759.670467:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.670476:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.670483:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.670502:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592759.670657:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+30:2343:x1875475136843008:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 304us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.670665:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00010000:00010000:0.0:1788592759.671408:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325113cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bbd expref: 29 pid: 6700 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.671432:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147333248:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592759.671454:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.671462:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.671467:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592759.671599:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788592759.672041:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788592759.672157:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147333376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592759.672217:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592759.672322:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592759.673380:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147333376 00000100:00100000:3.0:1788592759.673390:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147333376 00000100:00100000:0.0:1788592759.673581:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592759.673591:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147333376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592759.673961:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147333376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 371us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592759.673969:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592759.674042:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147333376:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788592759.675116:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788592759.675373:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147333504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788592759.675428:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592759.675464:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592759.675603:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147333504 00000100:00100000:2.0:1788592759.675612:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147333504 00000100:00100000:2.0:1788592759.675676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592759.675686:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147333504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592759.676546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5826:x1875475147333504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 858us (1113us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788592759.676557:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592759.676642:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147333504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788592759.676736:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788592759.676777:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.676798:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.676807:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.676812:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592759.676817:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.677418:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.677435:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:0.0:1788592759.677438:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788592759.677443:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592759.677450:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f132511434 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592759.677677:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788592759.677802:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788592759.677815:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333918464581ns, next at 334918462170ns, rc = 0 00000001:00080000:0.0:1788592759.678456:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788592759.678515:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a900) 00010000:00010000:0.0:1788592759.678520:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788592759.678543:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251141f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1be7 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592759.678725:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11373:x1875475136842880:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 15980us (16300us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788592759.678735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000020:00080000:0.0:1788592759.678739:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788592759.682276:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.682563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136843136 00000100:00100000:2.0:1788592759.682576:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136843136 00000100:00100000:2.0:1788592759.682646:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:2.0:1788592759.682658:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11373:x1875475136843136:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592759.682689:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592759.682725:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251143b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bee expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.682792:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251143b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bee expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.682823:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251143b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bee expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.682846:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592759.682849:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592759.682853:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5a00, rc 0) 00000100:00100000:2.0:1788592759.683193:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11373:x1875475136843136:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 537us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.683200:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 148 00000100:00100000:2.0:1788592759.687859:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.688004:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136843392 00000100:00100000:1.0:1788592759.688016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136843392 00000100:00100000:1.0:1788592759.688082:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1788592759.688092:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11373:x1875475136843392:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592759.688438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11373:x1875475136843392:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 347us (590us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788592759.688446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1788592759.796783:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.796978:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136843648 00000100:00100000:2.0:1788592759.796991:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136843648 00000100:00100000:2.0:1788592759.797062:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:2.0:1788592759.797075:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11383:x1875475136843648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592759.797103:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592759.797126:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bf5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592759.797236:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788592759.797423:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511442 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bf5 expref: 36 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.797437:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:2.0:1788592759.797440:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592759.797445:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bf5 expref: 36 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.797479:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5200, rc 0) 00000100:00100000:2.0:1788592759.797550:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11383:x1875475136843648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 477us (777us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788592759.797557:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 149 00000100:00100000:0.0:1788592759.804224:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.804376:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136843776 00000100:00100000:2.0:1788592759.804387:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136843776 00000100:00100000:2.0:1788592759.804459:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:2.0:1788592759.804471:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11383:x1875475136843776:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:2.0:1788592759.804561:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804574:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804585:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804598:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804602:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804606:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804861:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804888:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804896:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788592759.804943:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804958:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804965:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804971:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804977:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.804986:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.804996:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805012:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592759.805016:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.805021:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805027:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805048:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805053:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805059:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805063:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.805065:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805070:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805076:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a1fe1f00) 00010000:00010000:2.0:1788592759.805078:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.805080:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805085:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511457 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805101:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805106:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805111:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805120:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.805123:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805128:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805134:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592759.805136:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.805139:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.805144:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f13251145e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592759.805266:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11383:x1875475136843776:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 796us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592759.805274:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 150 00000100:00100000:0.0:1788592759.808733:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.808804:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136844032 00000100:00100000:2.0:1788592759.808816:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136844032 00000100:00100000:2.0:1788592759.808880:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:2.0:1788592759.808892:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11383:x1875475136844032:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592759.809142:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11383:x1875475136844032:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 251us (426us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788592759.809149:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1788592759.865532:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.865625:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136844288 00000100:00100000:2.0:1788592759.865636:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136844288 00000100:00100000:2.0:1788592759.865710:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:2.0:1788592759.865739:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11386:x1875475136844288:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592759.865765:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592759.865787:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511465 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1bfc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865866:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865882:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865893:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865907:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865914:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.865921:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866048:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866056:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866062:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592759.866077:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788592759.866172:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866181:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866188:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866195:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.866207:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866214:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866227:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592759.866230:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.866235:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866242:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f13251146c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866259:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866266:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866294:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866299:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592759.866302:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866308:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866317:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a1fe1f00) 00010000:00010000:2.0:1788592759.866319:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592759.866322:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866328:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511473 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866437:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511465 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 39 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866451:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 38 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592759.866458:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592759.866460:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592759.866463:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5c00, rc 0) 00000100:00100000:2.0:1788592759.870236:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11386:x1875475136844288:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4483us (4697us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788592759.870340:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 151 00000100:00100000:0.0:1788592759.876116:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592759.876193:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136844416 00000100:00100000:1.0:1788592759.876203:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136844416 00000100:00100000:1.0:1788592759.876256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:1.0:1788592759.876267:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11386:x1875475136844416:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592759.876399:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876417:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876429:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876458:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876465:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876472:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876479:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592759.876483:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.876491:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.877167:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:1.0:1788592759.877173:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592759.877178:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592759.877185:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f132511488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592759.877306:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11386:x1875475136844416:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 1040us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592759.877315:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 152 00000100:00100000:0.0:1788592759.880948:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592759.881073:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136844672 00000100:00100000:2.0:1788592759.881084:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136844672 00000100:00100000:2.0:1788592759.881142:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:2.0:1788592759.881154:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11386:x1875475136844672:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592759.881588:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+39:11386:x1875475136844672:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 436us (648us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788592759.881596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00010000:00010000:0.0:1788592760.067419:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592760.131985:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.133418:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136844928 00000100:00100000:3.0:1788592760.133433:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136844928 00000100:00100000:3.0:1788592760.133513:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:3.0:1788592760.133525:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+39:11417:x1875475136844928:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:3.0:1788592760.133552:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592760.133576:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251148f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c03 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.133709:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511496 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.133731:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.133744:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511496 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592760.133756:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788592760.133898:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251148f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c03 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.133920:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c03 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.133929:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.133932:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592760.133936:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5000, rc 0) 00000100:00100000:3.0:1788592760.134409:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+41:11417:x1875475136844928:12345-192.168.204.20@tcp:101:cat.0 Request processed in 824us (2374us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788592760.134418:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 153 00000100:00100000:0.0:1788592760.144665:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592760.144772:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.144952:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136845312 00000100:00100000:3.0:1788592760.144974:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136845312 00000100:00100000:3.0:1788592760.145051:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:3.0:1788592760.145062:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+41:2343:x1875475136845312:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592760.145080:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592760.145104:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c03 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.145125:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.145130:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592760.145207:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+40:2343:x1875475136845312:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 147us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.145215:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1788592760.146904:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136845184 00000100:00100000:1.0:1788592760.146917:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136845184 00000100:00100000:1.0:1788592760.146983:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1788592760.146993:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+40:11417:x1875475136845184:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:1.0:1788592760.151013:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+41:11417:x1875475136845184:12345-192.168.204.20@tcp:35:cat.0 Request processed in 4006us (6344us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788592760.151029:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:0.0:1788592760.256252:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.256728:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136845568 00000100:00100000:1.0:1788592760.256741:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136845568 00000100:00100000:1.0:1788592760.256817:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:1.0:1788592760.256827:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+41:11423:x1875475136845568:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1788592760.256853:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592760.256857:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788592760.257015:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325113fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bd9 expref: 41 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257038:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592760.257044:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592760.257059:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f1325114a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c0a expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257167:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257196:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 41 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257205:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257241:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 41 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.257255:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 41 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592760.257270:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147333632:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592760.257489:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592760.261015:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.261135:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147333632:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592760.261168:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592760.262168:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136845696 00000100:00100000:0.0:1788592760.262186:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136845696 00010000:00010000:0.0:1788592760.262259:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 42 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592760.262329:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:0.0:1788592760.262339:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+42:2344:x1875475136845696:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592760.262920:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592760.262930:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 42 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.262944:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 42 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.262984:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251147a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bfc expref: 42 pid: 6700 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.263002:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:0.0:1788592760.263007:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.263017:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.263024:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.263047:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592760.263180:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+41:2344:x1875475136845696:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 841us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592760.263189:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00010000:00010000:3.0:1788592760.263214:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.263222:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592760.263244:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788592760.263448:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be000/0x27b316f1325114a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 42 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.263463:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.263478:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.263481:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592760.263484:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be800, rc 0) 00000100:00100000:3.0:1788592760.263512:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+41:11423:x1875475136845568:12345-192.168.204.20@tcp:101:dd.0 Request processed in 6686us (7270us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788592760.263519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 154 00000100:00100000:2.0:1788592760.269855:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.270219:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136845952 00000100:00100000:1.0:1788592760.270231:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136845952 00000100:00100000:1.0:1788592760.270318:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 155 00000100:00100000:1.0:1788592760.270330:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+41:11423:x1875475136845952:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:1.0:1788592760.270940:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.270960:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.270973:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788592760.271034:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788592760.271081:0:6700:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d659aa46 reply state 000000008a4a23fe transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592760.271091:0:6700:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592760.271579:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+44:11423:x1875475136845952:12345-192.168.204.20@tcp:36:dd.0 Request processed in 1247us (1731us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788592760.271588:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 155 00000020:00080000:1.0:1788592760.271594:0:6700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592760.281076:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281094:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281101:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281107:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592760.281112:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281120:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281148:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.281150:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592760.281155:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.281161:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325114b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592760.675317:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.675439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846080 00000100:00100000:1.0:1788592760.675451:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846080 00000100:00100000:1.0:1788592760.675665:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 156 00000100:00100000:1.0:1788592760.675678:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+43:11437:x1875475136846080:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:1.0:1788592760.675704:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592760.675728:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325114c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c11 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675800:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675817:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675830:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675845:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675852:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.675891:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.678870:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.678894:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.678905:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.678949:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.678968:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 44 pid: 5824 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592760.678996:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147333760:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592760.679102:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592760.695548:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.696300:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc90d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147333760:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592760.696331:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592760.697095:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846336 00000100:00100000:0.0:1788592760.697102:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846336 00000100:00100000:0.0:1788592760.697185:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1788592760.697195:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+45:5583:x1875475136846336:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788592760.698728:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+46:5583:x1875475136846336:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 1526us (3182us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788592760.698740:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000001:00080000:0.0:1788592760.701037:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1788592760.701054:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788592760.708211:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.708419:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846464 00000100:00100000:3.0:1788592760.708430:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846464 00010000:00010000:3.0:1788592760.708485:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 46 pid: 5824 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592760.708528:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:3.0:1788592760.708538:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+46:2344:x1875475136846464:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592760.708554:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592760.708560:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 46 pid: 5824 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708574:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 46 pid: 5824 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708596:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325114ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c0a expref: 46 pid: 5824 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708613:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.708618:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708629:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708647:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.708682:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592760.708741:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+45:2344:x1875475136846464:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 204us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.708748:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00010000:00010000:2.0:1788592760.709403:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709412:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592760.709474:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788592760.709479:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592760.709509:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709524:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709536:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709542:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709559:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709565:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592760.709570:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709579:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709591:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592760.709594:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592760.709598:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709605:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325114c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709620:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709626:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709631:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709635:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592760.709638:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709654:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709663:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89818289a700) 00010000:00010000:2.0:1788592760.709666:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592760.709669:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709675:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325114ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709717:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f1325114c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c11 expref: 45 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709733:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c11 expref: 44 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592760.709740:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592760.709742:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592760.709745:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bee00, rc 0) 00000100:00100000:2.0:1788592760.709803:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+44:11437:x1875475136846080:12345-192.168.204.20@tcp:101:stat.0 Request processed in 34128us (34496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.709812:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 156 00000001:00080000:2.0:1788592760.717068:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967431 is committed 00000004:00080000:2.0:1788592760.717082:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788592760.717111:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff898085081780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788592760.717116:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc1e9800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8980850813c0 00000020:00080000:2.0:1788592760.717137:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981bc1e9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc800800 00000020:00080000:1.0:1788592760.717175:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788592760.717388:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788592760.717573:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147333888:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788592760.717645:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592760.718330:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147333888 00000100:00100000:1.0:1788592760.718341:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147333888 00000100:00100000:1.0:1788592760.718433:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788592760.718444:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147333888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788592760.718482:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788592760.718525:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9bc276, atime: 0x6a9bc276, ctime: 0x6a9bc276, blocks: 0xb 00010000:00010000:1.0:1788592760.718533:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.718549:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788592760.718553:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592760.718559:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.718576:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.718586:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.718594:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592760.718611:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788592760.719182:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147333888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 739us (1535us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788592760.719190:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788592760.719254:0:3285:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788592760.719260:0:3285:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788592760.719296:0:3285:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8981bca9f100 x1875475147333888/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788592776 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788592760.719308:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bca9f100/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788592760.719313:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147333888:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788592760.719658:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592760.719667:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.719676:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bec00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592760.719680:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.719689:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.719708:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.719715:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b35baf36/0x27b316f1325114dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592760.719736:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592760.719738:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592760.719739:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592760.719955:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000100:00100000:0.0:1788592760.803078:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.803312:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846720 00000100:00100000:3.0:1788592760.803324:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846720 00000100:00100000:3.0:1788592760.803448:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 157 00000100:00100000:3.0:1788592760.803460:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+17:11443:x1875475136846720:12345-192.168.204.20@tcp:36:truncate.0 00010000:00010000:3.0:1788592760.803531:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592760.803562:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bee00/0x27b316f1325114d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c11 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.803583:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.803590:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592760.804446:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.804463:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.804472:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592760.804536:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788592760.804564:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099669a5b reply state 00000000c09e9ece transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592760.804589:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592760.805286:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11443:x1875475136846720:12345-192.168.204.20@tcp:36:truncate.0 Request processed in 1825us (2224us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788592760.805296:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 157 00000020:00080000:3.0:1788592760.805303:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788592760.816053:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.816163:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.816190:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592760.816256:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592760.818966:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846848 00000100:00100000:3.0:1788592760.818984:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846848 00000100:00100000:3.0:1788592760.819048:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:3.0:1788592760.819058:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136846848:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592760.819146:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981904dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136846848:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (2982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.819155:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:3.0:1788592760.819199:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136846976 00000100:00100000:3.0:1788592760.819203:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136846976 00000100:00100000:3.0:1788592760.819538:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136847104 00000100:00100000:3.0:1788592760.819543:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136847104 00000100:00100000:3.0:1788592760.819576:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1788592760.819583:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136846976:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592760.819616:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136846976:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 33us (3572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.819623:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:3.0:1788592760.819636:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:3.0:1788592760.819642:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136847104:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592760.819870:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2344:x1875475136847104:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 228us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592760.819895:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00080000:3.0:1788592760.819921:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592760.820747:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136847232 00000100:00100000:2.0:1788592760.820756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136847232 00000100:00100000:2.0:1788592760.820804:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:2.0:1788592760.820813:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136847232:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592760.820867:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2343:x1875475136847232:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 55us (4610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592760.820875:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00010000:00010000:3.0:1788592760.824005:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824024:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824034:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824040:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592760.824045:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824053:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824082:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592760.824086:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592760.824091:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592760.824098:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325114e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.035488:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.035668:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136847360 00000100:00100000:2.0:1788592761.035680:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136847360 00000100:00100000:2.0:1788592761.035759:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00100000:2.0:1788592761.035772:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11457:x1875475136847360:12345-192.168.204.20@tcp:101:stat.0 00010000:00010000:2.0:1788592761.035798:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592761.035822:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325114ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c18 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035897:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035912:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035929:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035944:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035971:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.035978:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036322:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036331:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036339:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592761.036416:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788592761.036430:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592761.036456:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036470:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036479:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036484:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036491:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036507:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592761.036511:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036520:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036532:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592761.036534:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592761.036539:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036545:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325114f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036562:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036568:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036574:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036579:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592761.036582:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036588:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036607:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a1fe1f00) 00010000:00010000:2.0:1788592761.036609:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592761.036613:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036618:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f1325114f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036655:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325114ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 20 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036669:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 19 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.036677:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592761.036680:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592761.036682:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5400, rc 0) 00000100:00100000:2.0:1788592761.036759:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11457:x1875475136847360:12345-192.168.204.20@tcp:101:stat.0 Request processed in 990us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592761.036768:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 158 00000100:00080000:3.0:1788592761.038104:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788592761.088122:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592761.200572:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.202808:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136847616 00000100:00100000:2.0:1788592761.202827:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136847616 00000100:00100000:2.0:1788592761.203070:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:2.0:1788592761.203084:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11467:x1875475136847616:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592761.203111:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592761.203151:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511506 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c1f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592761.203296:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788592761.203467:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511506 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c1f expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.203493:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:2.0:1788592761.203505:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788592761.203511:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511506 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c1f expref: 21 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.203529:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:2.0:1788592761.203618:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11467:x1875475136847616:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 537us (3119us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788592761.203625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 159 00000100:00100000:1.0:1788592761.225587:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.226860:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136847872 00000100:00100000:2.0:1788592761.226873:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136847872 00000100:00100000:2.0:1788592761.226966:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:2.0:1788592761.226979:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11467:x1875475136847872:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592761.227323:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:11467:x1875475136847872:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 346us (1746us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788592761.227331:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1788592761.323544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.323695:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136848128 00000100:00100000:2.0:1788592761.323709:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136848128 00000100:00100000:2.0:1788592761.323795:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:2.0:1788592761.323807:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+21:11473:x1875475136848128:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592761.323840:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592761.324654:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511514 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c26 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.324805:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.324825:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 22 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.324835:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.325614:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 22 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.325638:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 22 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592761.325657:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147334016:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592761.325786:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592761.334135:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147334016:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592761.334177:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.334749:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592761.336723:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136848256 00000100:00100000:0.0:1788592761.336741:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136848256 00010000:00010000:0.0:1788592761.336808:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 23 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592761.336899:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1788592761.336910:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:2344:x1875475136848256:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592761.336933:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592761.336941:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 23 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.336957:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 23 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.336988:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f1325114ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c18 expref: 23 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.337014:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:0.0:1788592761.337192:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.337207:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.337216:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.337270:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592761.337405:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:2344:x1875475136848256:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 442us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592761.337414:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00010000:00010000:1.0:1788592761.338719:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.338735:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592761.338763:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788592761.338994:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511514 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 23 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.339019:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 22 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.339028:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:1.0:1788592761.339032:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592761.339036:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:1.0:1788592761.339127:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11473:x1875475136848128:12345-192.168.204.20@tcp:101:bash.0 Request processed in 15322us (15600us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788592761.339136:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 160 00000100:00100000:1.0:1788592761.370654:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592761.370764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136848512 00000100:00100000:3.0:1788592761.370777:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136848512 00000100:00100000:3.0:1788592761.370863:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 161 00000100:00100000:3.0:1788592761.370876:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11473:x1875475136848512:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1788592761.371281:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.371306:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.371322:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592761.371438:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788592761.371466:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c76e8399 reply state 00000000a58dd615 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592761.371476:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592761.371599:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11473:x1875475136848512:12345-192.168.204.20@tcp:36:bash.0 Request processed in 725us (960us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788592761.371608:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 161 00000020:00080000:3.0:1788592761.371613:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592761.373876:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373898:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373907:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373913:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592761.373918:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373928:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373966:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592761.373969:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592761.373976:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.373984:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511529 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.392655:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592761.393266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136848640 00000100:00100000:0.0:1788592761.393298:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136848640 00000100:00100000:0.0:1788592761.393407:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:0.0:1788592761.393419:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11473:x1875475136848640:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592761.393452:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592761.393481:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c2d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.393597:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.393617:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 25 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.393626:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.393669:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 25 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592761.393686:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 25 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592761.393703:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147334144:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592761.393813:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592761.400016:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592761.400481:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147334144:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592761.400518:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.401321:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136848768 00000100:00100000:1.0:1788592761.401333:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136848768 00010000:00010000:1.0:1788592761.401442:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 26 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.401483:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:1.0:1788592761.401507:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:2344:x1875475136848768:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592761.401526:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592761.401535:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 26 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401549:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 26 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401591:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251151b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c26 expref: 26 pid: 6700 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401614:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:1.0:1788592761.401620:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401632:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401666:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.401705:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592761.401795:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+25:2344:x1875475136848768:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 289us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592761.401804:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00010000:00010000:3.0:1788592761.401990:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.401999:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592761.402063:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788592761.402068:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592761.402094:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.402134:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c2d expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.402153:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c2d expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.402162:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592761.402175:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592761.402179:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb600, rc 0) 00000100:00100000:3.0:1788592761.402213:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11473:x1875475136848640:12345-192.168.204.20@tcp:101:bash.0 Request processed in 8797us (9574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592761.402221:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 162 00000100:00100000:3.0:1788592761.414598:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.414755:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136849024 00000100:00100000:2.0:1788592761.414769:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136849024 00000100:00100000:2.0:1788592761.414847:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1788592761.414868:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11473:x1875475136849024:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:2.0:1788592761.415211:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11473:x1875475136849024:12345-192.168.204.20@tcp:35:bash.0 Request processed in 353us (630us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788592761.415236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1788592761.579575:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592761.579818:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136849280 00000100:00100000:3.0:1788592761.579833:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136849280 00000100:00100000:3.0:1788592761.579914:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:3.0:1788592761.579927:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11483:x1875475136849280:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592761.579960:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592761.579991:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251153e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c34 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592761.580124:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788592761.580290:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251153e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c34 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.580309:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:3.0:1788592761.580312:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592761.580320:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f13251153e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c34 expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.580336:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5000, rc 0) 00000100:00100000:3.0:1788592761.580465:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11483:x1875475136849280:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 540us (905us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788592761.580472:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 163 00000100:00100000:0.0:1788592761.592146:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592761.595386:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136849408 00000100:00100000:1.0:1788592761.595406:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136849408 00000100:00100000:1.0:1788592761.595489:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:1.0:1788592761.595501:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11483:x1875475136849408:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1788592761.595610:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.595639:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.595653:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.595673:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.595679:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.595686:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596099:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596118:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596127:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592761.596335:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596384:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596396:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596406:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596412:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592761.596420:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596431:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596450:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592761.596454:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592761.596460:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596469:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251154c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596495:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596501:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596506:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596512:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592761.596515:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596522:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596530:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89818289a900) 00010000:00010000:1.0:1788592761.596532:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592761.596536:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596542:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f132511553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596558:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596687:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596693:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596705:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592761.596708:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596715:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596724:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:1.0:1788592761.596726:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592761.596730:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.596735:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f13251155a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592761.596920:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11483:x1875475136849408:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1416us (4785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592761.596930:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 164 00000100:00100000:1.0:1788592761.609536:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.613135:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136849664 00000100:00100000:2.0:1788592761.613158:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136849664 00000100:00100000:2.0:1788592761.613331:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1788592761.613344:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11483:x1875475136849664:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592761.613693:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11483:x1875475136849664:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 350us (4175us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788592761.613702:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1788592761.717658:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592761.717916:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136849920 00000100:00100000:3.0:1788592761.717929:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136849920 00000100:00100000:3.0:1788592761.718006:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:3.0:1788592761.718027:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11486:x1875475136849920:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592761.718062:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592761.718088:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511561 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c3b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718197:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718215:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718229:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718257:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718266:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718272:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718741:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718753:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.718775:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592761.720209:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788592761.720390:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720399:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720407:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720414:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592761.720419:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720428:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720449:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592761.720452:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592761.720459:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720466:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511568 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720483:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720489:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720508:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720514:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592761.720517:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720524:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720533:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981898bf900) 00010000:00010000:3.0:1788592761.720536:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592761.720539:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.720545:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251156f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.721298:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511561 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c3b expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.721321:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c3b expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.721329:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592761.721331:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592761.721335:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4400, rc 0) 00000100:00100000:3.0:1788592761.721487:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11486:x1875475136849920:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3470us (3844us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788592761.721510:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:0.0:1788592761.726422:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592761.726533:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592761.726675:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136850048 00000100:00100000:3.0:1788592761.726690:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136850048 00000100:00100000:3.0:1788592761.726765:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:3.0:1788592761.726786:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11486:x1875475136850048:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1788592761.726877:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726898:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726913:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726945:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726953:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726965:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726971:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592761.726976:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726985:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.726998:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592761.727030:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592761.727037:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592761.727044:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f132511584 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592761.727140:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11486:x1875475136850048:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 365us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592761.727149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 166 00000100:00100000:1.0:1788592761.728290:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136850176 00000100:00100000:1.0:1788592761.728303:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136850176 00000100:00100000:1.0:1788592761.728396:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:1.0:1788592761.728408:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:2342:x1875475136850176:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592761.728423:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592761.728449:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c3b expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592761.728468:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:1.0:1788592761.728487:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592761.728544:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+28:2342:x1875475136850176:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 139us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592761.728553:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:0.0:1788592761.736553:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592761.736674:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136850432 00000100:00100000:1.0:1788592761.736689:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136850432 00000100:00100000:1.0:1788592761.736759:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:1.0:1788592761.736771:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11486:x1875475136850432:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592761.737088:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11486:x1875475136850432:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 317us (549us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788592761.737096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1788592761.985412:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592761.985793:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136850688 00000100:00100000:2.0:1788592761.985807:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136850688 00000100:00100000:2.0:1788592761.985887:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:2.0:1788592761.985899:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11504:x1875475136850688:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1788592761.985933:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592761.985961:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251158b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c42 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.986095:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511592 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.986113:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.986128:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511592 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592761.986165:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788592761.986342:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f13251158b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c42 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.986386:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511592 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c42 expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592761.986397:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:2.0:1788592761.986400:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788592761.986404:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:2.0:1788592761.987544:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11504:x1875475136850688:12345-192.168.204.20@tcp:101:cat.0 Request processed in 1635us (2136us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788592761.987556:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 167 00000100:00100000:0.0:1788592762.035585:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592762.035691:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136850816 00000100:00100000:3.0:1788592762.035705:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136850816 00000100:00100000:3.0:1788592762.035775:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:3.0:1788592762.035786:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11505:x1875475136850816:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592762.035820:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592762.035847:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c49 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037391:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037417:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037432:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592762.037479:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788592762.037484:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592762.037527:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037567:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c49 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037593:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c49 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.037603:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592762.037606:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592762.037610:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:3.0:1788592762.037708:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11505:x1875475136850816:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1922us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.037717:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 168 00000100:00100000:3.0:1788592762.042673:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592762.042866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851200 00000100:00100000:1.0:1788592762.042880:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851200 00000100:00100000:1.0:1788592762.042967:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1788592762.042979:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11505:x1875475136851200:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592762.043663:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11505:x1875475136851200:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 682us (1001us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788592762.043683:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:1.0:1788592762.050832:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592762.050987:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851328 00000100:00100000:3.0:1788592762.051000:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851328 00000100:00100000:3.0:1788592762.051087:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1788592762.051099:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11505:x1875475136851328:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:3.0:1788592762.051119:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788592762.051155:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c2d expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.051522:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511592 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c42 expref: 32 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.051540:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f13251143b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bee expref: 31 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.051572:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a1fe1000) 00010000:00010000:3.0:1788592762.051587:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592762.051655:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+30:11505:x1875475136851328:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 559us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.051673:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1788592762.058876:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592762.059010:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851456 00000100:00100000:3.0:1788592762.059023:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851456 00000100:00100000:3.0:1788592762.059095:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:3.0:1788592762.059107:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+30:11505:x1875475136851456:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:3.0:1788592762.059262:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.059286:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.059301:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592762.059976:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788592762.060100:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+30:11505:x1875475136851456:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 993us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.060110:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:2.0:1788592762.090074:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592762.090185:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851584 00000100:00100000:1.0:1788592762.090196:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851584 00000100:00100000:1.0:1788592762.090271:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:1.0:1788592762.090282:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+30:11507:x1875475136851584:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592762.090308:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592762.090333:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325115b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c50 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090457:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090475:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090488:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090503:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090510:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.090516:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092293:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092316:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092328:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592762.092405:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788592762.092410:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592762.092434:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092462:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092472:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092480:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092488:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092494:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592762.092498:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092507:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092521:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592762.092525:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592762.092531:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092538:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325115bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092552:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092558:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092571:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092576:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592762.092579:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092585:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092594:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89818289a900) 00010000:00010000:1.0:1788592762.092597:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592762.092599:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092606:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325115c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.092657:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325115b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 32 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.094867:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 31 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592762.094885:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:1.0:1788592762.094888:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592762.094892:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be600, rc 0) 00000100:00100000:1.0:1788592762.094995:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11507:x1875475136851584:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 4712us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592762.095023:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00010000:00010000:0.0:1788592762.111066:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592762.942702:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592762.942715:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592762.942759:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788592762.942768:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788592762.943001:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147334272:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592762.944249:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981933f5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788592762.953062:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc817b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147334272:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592762.956558:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592762.956834:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851712 00000100:00100000:3.0:1788592762.956848:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851712 00000100:00100000:3.0:1788592762.956925:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:3.0:1788592762.956938:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11518:x1875475136851712:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592762.956996:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592762.957214:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11518:x1875475136851712:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 278us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.957234:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 171 00000100:00100000:2.0:1788592762.965449:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592762.972612:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136851840 00000100:00100000:3.0:1788592762.972633:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136851840 00000100:00100000:3.0:1788592762.972770:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:3.0:1788592762.972784:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11518:x1875475136851840:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788592762.972887:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.972921:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.972938:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973050:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973059:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973066:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973103:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973111:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973137:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592762.973186:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788592762.973190:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592762.973206:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973216:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973234:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973242:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973247:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592762.973252:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973260:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973274:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:3.0:1788592762.973277:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592762.973282:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973288:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f1325115d1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973314:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973320:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973326:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973331:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c4400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592762.973334:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973340:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973379:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8981898bfa00) 00010000:00010000:3.0:1788592762.973383:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592762.973386:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973392:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f1325115d8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973410:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973416:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973422:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973434:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592762.973437:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973443:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973452:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:3.0:1788592762.973454:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592762.973467:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592762.973474:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592762.973582:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11518:x1875475136851840:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 799us (8147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592762.973591:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 172 00000100:00100000:1.0:1788592763.000057:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.000173:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136852096 00000100:00100000:3.0:1788592763.000197:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136852096 00000100:00100000:3.0:1788592763.000284:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:3.0:1788592763.000296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11518:x1875475136852096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.000323:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592763.000399:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c57 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.000795:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.000837:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.000852:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592763.000866:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788592763.001044:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001053:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001060:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001066:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592763.001071:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001079:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001094:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:3.0:1788592763.001097:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592763.001103:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001109:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f1325115ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001160:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115e6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c57 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001179:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:3.0:1788592763.001194:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592763.001199:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f1325115e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c57 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.001214:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:3.0:1788592763.001305:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1011us (1261us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788592763.001314:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 173 00000100:00100000:0.0:1788592763.007601:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.007738:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136852224 00000100:00100000:3.0:1788592763.007752:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136852224 00000100:00100000:3.0:1788592763.007835:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1788592763.007848:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852224:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788592763.007900:0:6700:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788592763.008037:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852224:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 191us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.008045:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00080000:0.0:1788592763.008495:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592763.025566:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.026053:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136852480 00000100:00100000:3.0:1788592763.026066:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136852480 00000100:00100000:3.0:1788592763.026692:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:3.0:1788592763.026707:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.026736:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592763.026740:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788592763.026778:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f1325115a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c49 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.026819:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592763.026826:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592763.026845:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325115fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c5e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788592763.029500:0:5824:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788592763.029845:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132511602 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.029867:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132511602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.029881:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132511602 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.029978:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325115fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c5e expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.030196:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132511602 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c5e expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.030208:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:3.0:1788592763.030211:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592763.030215:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:3.0:1788592763.030386:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11518:x1875475136852480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 3680us (4832us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788592763.030396:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:2.0:1788592763.049242:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.059091:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136852736 00000100:00100000:3.0:1788592763.059115:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136852736 00000100:00100000:3.0:1788592763.059535:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:3.0:1788592763.059551:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11518:x1875475136852736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.059632:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592763.059670:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f132511602 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c5e expref: 33 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059693:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981898bfa00) 00010000:00010000:3.0:1788592763.059706:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592763.059735:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059752:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059763:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059781:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059788:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.059793:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060080:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060100:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060106:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060111:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592763.060116:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060124:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060133:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592763.060136:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592763.060140:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060147:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511610 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060158:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060164:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060169:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060173:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592763.060182:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060188:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060195:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfcbc2dda (ffff8981898bfc00) 00010000:00010000:3.0:1788592763.060198:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592763.060201:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.060207:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511617 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcbc2dda bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.060335:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 788us (11116us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788592763.060343:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 176 00000100:00100000:2.0:1788592763.065760:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.065971:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136852864 00000100:00100000:3.0:1788592763.065998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136852864 00000100:00100000:3.0:1788592763.066065:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:3.0:1788592763.066077:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11518:x1875475136852864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.066105:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592763.066135:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251161e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c65 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066181:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066198:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066235:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066371:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251161e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 34 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066389:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.066400:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:3.0:1788592763.066403:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592763.066408:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c4400, rc 0) 00000100:00100000:3.0:1788592763.066479:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11518:x1875475136852864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 405us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.066488:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 177 00000100:00100000:1.0:1788592763.068864:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.069246:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136853120 00000100:00100000:3.0:1788592763.069256:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136853120 00000100:00100000:3.0:1788592763.069313:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:3.0:1788592763.069321:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+33:11518:x1875475136853120:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.069575:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.069595:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.069609:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592763.069968:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788592763.069979:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337310627648ns, next at 338310625927ns, rc = 0 00000004:00010000:3.0:1788592763.070061:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a23ff4fb reply state 00000000bc252e8e transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.070069:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592763.070188:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11518:x1875475136853120:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 865us (1332us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788592763.070197:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 178 00000100:00100000:2.0:1788592763.073864:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1788592763.073947:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.073964:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.073973:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.073980:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592763.074045:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.074057:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.074079:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:3.0:1788592763.074083:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592763.074089:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.074109:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f13251162c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.074512:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136853248 00000100:00100000:0.0:1788592763.074525:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136853248 00000100:00100000:0.0:1788592763.074594:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:0.0:1788592763.074609:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11518:x1875475136853248:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592763.074641:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592763.074667:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c6c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.074741:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.074756:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 35 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.074779:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:0.0:1788592763.074783:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592763.074786:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca000, rc 0) 00000100:00100000:0.0:1788592763.074862:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11518:x1875475136853248:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 258us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592763.074870:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:0.0:1788592763.087890:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592763.088166:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136853376 00000100:00100000:1.0:1788592763.088180:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136853376 00000100:00100000:1.0:1788592763.088282:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:1.0:1788592763.088294:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136853376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788592763.088778:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136853376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 484us (901us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788592763.088788:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00080000:0.0:1788592763.089578:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592763.094345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592763.094654:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136853632 00000100:00100000:0.0:1788592763.094673:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136853632 00000100:00100000:0.0:1788592763.094750:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:0.0:1788592763.094762:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11518:x1875475136853632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592763.095087:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11518:x1875475136853632:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 326us (754us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788592763.095096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1788592763.113461:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.113585:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136853888 00000100:00100000:3.0:1788592763.113662:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136853888 00000100:00100000:3.0:1788592763.113736:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1788592763.113748:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11518:x1875475136853888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788592763.114416:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11518:x1875475136853888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 667us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.114427:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:1.0:1788592763.129961:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.130288:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854016 00000100:00100000:3.0:1788592763.130302:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854016 00000100:00100000:3.0:1788592763.130398:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 181 00000100:00100000:3.0:1788592763.130410:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11518:x1875475136854016:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.130437:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592763.130464:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251163a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c73 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.130575:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.131063:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.131094:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592763.131141:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592763.131174:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.131207:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5400/0x27b316f13251163a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c73 expref: 38 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.131238:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c73 expref: 37 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.131249:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:3.0:1788592763.131252:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592763.131256:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5200, rc 0) 00000100:00100000:3.0:1788592763.131333:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11518:x1875475136854016:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 925us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.131341:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 181 00010000:00010000:3.0:1788592763.141460:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592763.142896:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592763.145398:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854144 00000100:00100000:2.0:1788592763.145417:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854144 00000100:00100000:2.0:1788592763.145493:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1788592763.145505:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136854144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592763.145530:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592763.145557:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c7a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592763.145602:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc27a, blocks: 0x1 00010000:00010000:2.0:1788592763.145627:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788592763.145633:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592763.145645:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.145668:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.145685:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5c00, rc 0) 00000100:00100000:2.0:1788592763.150318:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136854144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4797us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592763.150336:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:1.0:1788592763.163403:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592763.163541:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854400 00000100:00100000:1.0:1788592763.163555:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854400 00000100:00100000:1.0:1788592763.163756:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:1.0:1788592763.163770:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11518:x1875475136854400:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788592763.164040:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11518:x1875475136854400:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 273us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592763.164049:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 182 00000100:00100000:2.0:1788592763.174010:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.174703:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854528 00000100:00100000:3.0:1788592763.174716:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854528 00000100:00100000:3.0:1788592763.174794:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1788592763.174807:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:11518:x1875475136854528:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.174841:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592763.174865:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c81 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.174906:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.174918:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592763.174938:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592763.174945:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 9 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.174992:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.175009:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.175028:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147334400:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592763.175861:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592763.189269:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592763.189305:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854656 00000100:00100000:1.0:1788592763.189316:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854656 00010000:00010000:1.0:1788592763.189392:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 10 pid: 6676 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592763.189432:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:1.0:1788592763.189442:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2344:x1875475136854656:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788592763.190247:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147334400:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592763.190290:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.190329:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c21c5400, rc 0) 00000100:00100000:2.0:1788592763.190415:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:11518:x1875475136854528:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 15611us (16418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592763.190424:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00010000:00010000:1.0:1788592763.190805:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592763.190837:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.190852:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.190881:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c7a expref: 9 pid: 6676 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.191131:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592763.191137:0:5809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592763.191147:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.191159:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.191496:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592763.191532:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981c21d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1875475147334528:192.168.204.20@tcp:105: 00000100:00100000:1.0:1788592763.191635:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592763.203228:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.203429:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981c21d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5809:1875475147334528:192.168.204.20@tcp:105: 00010000:00010000:3.0:1788592763.203464:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592763.203527:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136854656:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 14085us (14273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.203540:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1788592763.204076:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854784 00000100:00100000:0.0:1788592763.204086:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854784 00002000:00100000:0.0:1788592763.204151:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8981bcaace00 x1875475136854784/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:39/0 lens 504/0 e 0 to 0 dl 1788592774 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592763.204163:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaace00 with x1875475136854784 ext(0->8) 00002000:00010000:0.0:1788592763.204169:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaace00 00000100:00100000:0.0:1788592763.204206:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592763.204227:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136854784:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788592763.204798:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2344:x1875475136854784:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 579us (1588us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788592763.204809:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00002000:00100000:0.0:1788592763.204817:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8981bcaace00 x1875475136854784/t4294967314(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:39/0 lens 504/448 e 0 to 0 dl 1788592774 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592763.204826:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bcaace00 with x1875475136854784 ext(0->8) 00002000:00010000:0.0:1788592763.204830:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981bcaace00 00000040:00080000:3.0:1788592763.251393:0:12444:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592763.251405:0:12444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592763.251868:0:12444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788592763.251876:0:12444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788592763.254336:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592763.258158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136854912 00000100:00100000:1.0:1788592763.258182:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136854912 00000100:00100000:1.0:1788592763.258284:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:1.0:1788592763.258296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bcaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11518:x1875475136854912:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788592763.401178:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1788592763.401244:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1788592763.401284:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1788592763.402109:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788592763.402201:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592763.402391:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147334656 00000100:00100000:2.0:1788592763.402401:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147334656 00000100:00100000:2.0:1788592763.402477:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592763.402488:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147334656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788592763.402676:0:8688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788592763.402680:0:8688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788592762 00002000:00010000:2.0:1788592763.402682:0:8688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788592763.402684:0:8688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788592762 -> 1788592762 00002000:00010000:2.0:1788592763.402686:0:8688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1788592763.402775:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788592763.405997:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788592763.406027:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788592763.406204:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bcaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11518:x1875475136854912:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 147901us (151875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592763.406245:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 183 00000100:00100000:2.0:1788592763.410509:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1875475147334656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8006us (8291us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788592763.410527:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788592763.414132:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bd15dc00/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788592763.414156:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788592763.416079:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.416393:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855040 00000100:00100000:3.0:1788592763.416418:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855040 00000100:00100000:3.0:1788592763.416493:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1788592763.416506:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2343:x1875475136855040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788592763.480141:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788592763.480316:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788592763.480847:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136855040:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 64335us (64771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.480861:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1788592763.487298:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592763.489896:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855296 00000100:00100000:1.0:1788592763.489917:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855296 00000100:00100000:1.0:1788592763.490247:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:1.0:1788592763.490262:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11518:x1875475136855296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592763.490338:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592763.490402:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5200/0x27b316f132511641 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c73 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.490423:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:1.0:1788592763.490430:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592763.490483:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.490501:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592763.490513:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592763.491114:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c5c11b5 reply state 000000007f80bcce transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592763.491144:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592763.491310:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11518:x1875475136855296:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1049us (4023us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788592763.491319:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:0.0:1788592763.498900:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1788592763.498950:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.498965:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.498973:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.498979:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592763.498984:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.498993:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.499013:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:0.0:1788592763.499017:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592763.499023:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.499029:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f132511656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.499078:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855424 00000100:00100000:0.0:1788592763.499090:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855424 00000100:00100000:0.0:1788592763.499147:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:0.0:1788592763.499158:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136855424:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592763.499526:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788592763.499530:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788592762 -> 1788592760 00002000:00010000:0.0:1788592763.499533:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788592758 00002000:00010000:0.0:1788592763.499535:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788592762 -> 1788592760 00002000:00010000:0.0:1788592763.499537:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788592763.499604:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136855424:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 447us (717us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788592763.499613:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:2.0:1788592763.506853:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.506980:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855680 00000100:00100000:3.0:1788592763.506993:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855680 00000100:00100000:3.0:1788592763.507058:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:3.0:1788592763.507080:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11518:x1875475136855680:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.507597:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.507621:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.507632:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.507678:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.507694:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 18 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.507710:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147334784:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592763.507903:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592763.510872:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147334784:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592763.510934:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592763.516844:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592763.517568:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855808 00000100:00100000:0.0:1788592763.517582:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855808 00010000:00010000:0.0:1788592763.517648:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.517697:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1788592763.517709:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+19:2344:x1875475136855808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592763.517727:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592763.517736:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517752:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517779:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4400/0x27b316f132511625 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c65 expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517798:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:0.0:1788592763.517822:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517835:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517844:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.517875:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592763.517938:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2344:x1875475136855808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 231us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592763.517947:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00010000:00010000:2.0:1788592763.518947:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.518961:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.518997:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519005:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519012:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519020:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592763.519025:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519033:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519046:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:2.0:1788592763.519050:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788592763.519054:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.519730:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f13251165d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592763.519853:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+17:11518:x1875475136855680:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 12771us (13010us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788592763.519865:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 185 00000100:00100000:2.0:1788592763.530393:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.530568:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136855936 00000100:00100000:3.0:1788592763.530582:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136855936 00000100:00100000:3.0:1788592763.530651:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592763.530663:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136855936:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.530719:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.530743:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.530753:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592763.530758:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592763.530763:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.530820:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.530838:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 8 pid: 6677 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.530855:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147334912:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592763.530960:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592763.540636:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592763.540703:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898185e97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875475147334912:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592763.540738:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592763.541227:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136856064 00000100:00100000:2.0:1788592763.541237:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136856064 00010000:00010000:2.0:1788592763.541279:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 9 pid: 6677 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592763.541834:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1788592763.541848:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136856064:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592763.541867:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592763.541896:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 9 pid: 6677 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.541914:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 9 pid: 6677 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.541944:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011355d5b/0x27b316f13251164f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c81 expref: 9 pid: 6677 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.541961:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592763.541966:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592763.541974:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.541997:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.542031:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592763.542098:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136856064:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 253us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592763.542106:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00010000:00010000:3.0:1788592763.546189:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546242:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546290:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546300:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546311:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546319:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592763.546325:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546335:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546388:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.546397:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000885f7974/0x27b316f132511664 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.549337:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136855936:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 18658us (18940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.549379:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:3.0:1788592763.559899:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.559947:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136856320 00000100:00100000:3.0:1788592763.559959:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136856320 00000100:00100000:3.0:1788592763.560026:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 186 00000100:00100000:3.0:1788592763.560038:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898185e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+17:11518:x1875475136856320:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788592763.560157:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560178:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560193:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560640:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560655:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560665:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560713:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.560753:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 18 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.560772:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb248380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147335040:192.168.204.20@tcp:104: 00000100:00100000:3.0:1788592763.561005:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671540 going to sleep for 11 seconds 00000100:00100000:3.0:1788592763.573048:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.574125:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb248380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147335040:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592763.574162:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.579218:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136856448 00000100:00100000:0.0:1788592763.579246:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136856448 00010000:00010000:0.0:1788592763.579306:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.579369:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:0.0:1788592763.579381:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+19:2344:x1875475136856448:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592763.579399:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592763.579407:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579438:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579478:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511633 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c6c expref: 19 pid: 5823 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579496:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:0.0:1788592763.579502:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579513:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579522:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579559:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592763.579631:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2344:x1875475136856448:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 251us (6597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592763.579640:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00010000:00010000:0.0:1788592763.579804:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.579820:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592763.580054:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788592763.585242:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788592763.586168:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788592763.586332:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6700:1875475147335168:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788592763.586467:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592763.586509:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592763.588422:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335168 00000100:00100000:2.0:1788592763.588443:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335168 00000100:00100000:2.0:1788592763.588532:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592763.588544:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6700:x1875475147335168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788592763.588713:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6700:x1875475147335168:12345-0@lo:1000:mdt00_003.0 Request processed in 171us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592763.588722:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788592763.588784:0:6700:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788592763.588790:0:6700:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bd15dc00, transno 4294967315 00000100:00100000:2.0:1788592763.588806:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981ba575880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6700:1875475147335168:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788592763.589776:0:6700:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788592763.590693:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898182840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6700:1875475147335296:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788592763.590767:0:6700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592763.590806:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592763.592635:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335296 00000100:00100000:0.0:1788592763.592653:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335296 00000100:00100000:0.0:1788592763.592723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592763.592736:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6700:x1875475147335296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788592763.593111:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6700:x1875475147335296:12345-0@lo:1000:mdt00_003.0 Request processed in 377us (2343us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788592763.593119:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788592763.593605:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898182840e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6700:1875475147335296:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788592763.593656:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593686:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593694:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593700:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592763.593705:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593715:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593734:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de400) 00010000:00010000:2.0:1788592763.593738:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592763.593743:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593749:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511672 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593785:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593792:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593797:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.593802:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c21c5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592763.594602:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.594612:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.594929:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:2.0:1788592763.594933:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788592763.594939:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.594946:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5000/0x27b316f1325115ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.594983:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.595000:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 21 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.595011:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.595551:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 21 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592763.595574:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 21 pid: 6700 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592763.595593:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898182840380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147335424:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592763.595704:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc634a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592763.611233:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592763.611275:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136856576 00000100:00100000:3.0:1788592763.611287:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136856576 00010000:00010000:3.0:1788592763.611338:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 22 pid: 6700 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.611411:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1788592763.611425:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:2343:x1875475136856576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592763.611443:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592763.611451:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 22 pid: 6700 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.611465:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 22 pid: 6700 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.611514:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:3.0:1788592763.611520:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.611532:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.611540:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.611563:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592763.611624:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:2343:x1875475136856576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 202us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592763.611633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00010000:00010000:0.0:1788592763.612090:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325115ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c50 expref: 21 pid: 6700 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.612111:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898182840380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147335424:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592763.612141:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612152:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612157:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612173:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612181:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612188:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612204:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592763.612219:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612229:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612240:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:0.0:1788592763.612243:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592763.612248:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612254:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f132511679 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612268:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612273:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612279:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612284:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592763.612287:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612294:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612314:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981898bf900) 00010000:00010000:0.0:1788592763.612317:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592763.612320:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.612326:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251166b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592763.612620:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898185e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11518:x1875475136856320:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 52583us (52736us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788592763.612631:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 186 00000020:00080000:0.0:1788592763.612636:0:6700:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788592763.613627:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592763.613635:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592763.614162:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788592763.614173:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592763.618232:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592763.620333:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136856832 00000100:00100000:0.0:1788592763.620375:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136856832 00000100:00100000:1.0:1788592763.620705:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1788592763.620718:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898183f22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11518:x1875475136856832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788592763.625583:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788592763.625805:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788592763.626248:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.626272:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.626286:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.626309:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.626316:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592763.626323:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.626922:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592763.626932:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.626941:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592763.626947:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.626957:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.626973:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8981a03de800) 00010000:00010000:0.0:1788592763.626976:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592763.626981:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592763.627003:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592763.627005:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592763.627007:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592763.627040:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592763.627046:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592763.628076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898183f22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11518:x1875475136856832:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 7343us (9854us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788592763.628091:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000020:00080000:3.0:1788592763.628101:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592764.158776:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592764.671261:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147335552:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671382:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671435:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147336064:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671464:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671493:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788592764.671498:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147335680:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671519:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671538:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147336192:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671561:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671602:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147335808:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671640:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671660:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147336320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592764.671685:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671706:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788592764.671712:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147335936:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.671732:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592764.671750:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898182842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147336448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592764.671769:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592764.671970:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147336064 00000100:00100000:2.0:1788592764.671979:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147336064 00000100:00100000:2.0:1788592764.672057:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335680 00000100:00100000:2.0:1788592764.672061:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335680 00000100:00100000:2.0:1788592764.672076:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335808 00000100:00100000:2.0:1788592764.672078:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335808 00000100:00100000:2.0:1788592764.672094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788592764.672103:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147336064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592764.672171:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147336064:12345-0@lo:400:kworker.0 Request processed in 68us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592764.672179:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1788592764.672996:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592764.673245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788592764.673262:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147335680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592764.673323:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147335680:12345-0@lo:400:kworker.0 Request processed in 67us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592764.673329:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788592764.673456:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788592764.673465:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147335808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592764.673506:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147335808:12345-0@lo:400:kworker.0 Request processed in 43us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592764.673512:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788592764.673916:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147336320 00000100:00100000:1.0:1788592764.673925:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147336320 00000100:00100000:1.0:1788592764.673973:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147336448 00000100:00100000:1.0:1788592764.673976:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147336448 00000100:00100000:1.0:1788592764.673991:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592764.673998:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147336320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592764.674034:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592764.674087:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147336320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.674093:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788592764.674112:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592764.674118:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147336448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592764.674128:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788592764.674156:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147336448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.674161:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788592764.674184:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147336192 00000100:00100000:1.0:1788592764.674201:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147336192 00000100:00100000:1.0:1788592764.674248:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335936 00000100:00100000:1.0:1788592764.674252:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335936 00000100:00100000:1.0:1788592764.674271:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788592764.674278:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147336192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592764.674313:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147336192:12345-0@lo:400:kworker.0 Request processed in 36us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.674320:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788592764.674332:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788592764.674337:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147335936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592764.674385:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147335936:12345-0@lo:400:kworker.0 Request processed in 48us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.674392:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788592764.674421:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147335552 00000100:00100000:1.0:1788592764.674425:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147335552 00000100:00100000:1.0:1788592764.674580:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788592764.674587:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147335552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592764.674622:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147335552:12345-0@lo:400:kworker.0 Request processed in 35us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592764.674629:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1788592764.674671:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592764.675079:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bca50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147335936:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.675102:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898182842d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147336448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592764.675117:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc1e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147335808:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.675134:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147336320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592764.675208:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147335680:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.675220:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb360a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147336192:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.675230:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147335552:0@lo:400:kworker.0 00000100:00100000:3.0:1788592764.675243:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb360700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147336064:0@lo:400:kworker.0 00010000:00010000:0.0:1788592765.184473:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592765.510071:0:12498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592765.510084:0:12498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592765.510145:0:12498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788592765.510152:0:12498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788592765.655221:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592765.661000:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136857088 00000100:00100000:1.0:1788592765.661022:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136857088 00000100:00100000:1.0:1788592765.661132:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:1.0:1788592765.661145:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+22:11538:x1875475136857088:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592765.661187:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592765.661225:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c88 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788592765.661236:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788592765.661603:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f13251168e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.661622:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f13251168e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.661637:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f13251168e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592765.661650:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788592765.661891:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c88 expref: 25 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.662049:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f13251168e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c88 expref: 24 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.662059:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592765.662062:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592765.662066:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bec00, rc 0) 00000100:00100000:1.0:1788592765.662160:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11538:x1875475136857088:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1016us (6948us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788592765.662179:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 187 00000100:00100000:2.0:1788592765.667908:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592765.674696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136857216 00000100:00100000:1.0:1788592765.674714:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136857216 00000100:00100000:1.0:1788592765.674841:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:1.0:1788592765.674853:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11538:x1875475136857216:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:1.0:1788592765.674945:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.674972:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.674987:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675015:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675023:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675030:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675305:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675314:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675322:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592765.675385:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675400:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675408:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675425:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675431:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592765.675436:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675445:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675459:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592765.675462:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592765.675467:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675474:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f13251169c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675485:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675492:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675498:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675502:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592765.675505:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675518:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675526:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89818289a900) 00010000:00010000:1.0:1788592765.675529:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592765.675531:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675547:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325116a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675563:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675569:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675574:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675579:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592765.675582:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675588:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675594:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89818289a800) 00010000:00010000:1.0:1788592765.675606:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592765.675609:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.675623:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f1325116aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.675727:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11538:x1875475136857216:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 875us (7834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.675735:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 188 00000100:00100000:3.0:1788592765.728461:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592765.728544:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136857472 00000100:00100000:0.0:1788592765.728559:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136857472 00000100:00100000:0.0:1788592765.728633:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:0.0:1788592765.728645:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11541:x1875475136857472:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592765.728671:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592765.728697:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325116b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c8f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.728806:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.728825:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.728840:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.728857:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729151:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729163:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729541:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729552:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729560:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592765.729570:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788592765.729686:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729694:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729701:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729706:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592765.729711:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729720:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.729749:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:0.0:1788592765.729752:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592765.729759:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730236:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730260:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730267:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730274:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730279:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592765.730282:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730290:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730298:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff898185c2de00) 00010000:00010000:0.0:1788592765.730301:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592765.730304:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730310:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730473:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325116b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 27 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730492:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 26 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.730500:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:0.0:1788592765.730503:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592765.730507:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592765.730601:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11541:x1875475136857472:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1958us (2158us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788592765.730613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 189 00000100:00100000:1.0:1788592765.735385:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592765.736025:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136857600 00000100:00100000:3.0:1788592765.736038:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136857600 00000100:00100000:3.0:1788592765.737552:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:3.0:1788592765.737573:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11541:x1875475136857600:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:3.0:1788592765.737688:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737710:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737725:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737758:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737765:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737772:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737778:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592765.737783:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737793:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737806:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592765.737810:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592765.737817:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.737824:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f1325116d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592765.737945:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11541:x1875475136857600:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 378us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.737953:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 190 00000100:00100000:1.0:1788592765.743139:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592765.743320:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136857856 00000100:00100000:3.0:1788592765.743332:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136857856 00000100:00100000:3.0:1788592765.743403:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1788592765.743413:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11541:x1875475136857856:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592765.744051:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11541:x1875475136857856:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 636us (923us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788592765.744060:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:0.0:1788592765.801419:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592765.801463:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858112 00000100:00100000:0.0:1788592765.801475:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858112 00000100:00100000:0.0:1788592765.801539:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:0.0:1788592765.801551:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11066:x1875475136858112:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592765.801587:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592765.801619:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116db lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c96 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.801752:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.801771:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.801804:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.801852:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.801869:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 28 pid: 5823 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592765.801886:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898193bee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147336576:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592765.802102:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981c2150180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592765.805403:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592765.805750:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858240 00000100:00100000:0.0:1788592765.805762:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858240 00010000:00010000:0.0:1788592765.805818:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 29 pid: 5823 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592765.805887:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898193bee680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147336576:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592765.805923:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592765.805926:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:0.0:1788592765.806013:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+29:2344:x1875475136858240:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592765.806032:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592765.806401:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 29 pid: 5823 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806420:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 29 pid: 5823 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806459:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325116c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c8f expref: 29 pid: 5823 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806500:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:0.0:1788592765.806506:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806521:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806533:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806566:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592765.806644:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+28:2344:x1875475136858240:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 705us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592765.806652:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000001:00080000:0.0:1788592765.806690:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00010000:00010000:0.0:1788592765.806832:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.806841:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592765.806866:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788592765.807159:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f1325116db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 29 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.807190:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 28 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592765.807199:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:0.0:1788592765.807494:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592765.807497:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbe00, rc 0) 00000100:00100000:0.0:1788592765.807545:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11066:x1875475136858112:12345-192.168.204.20@tcp:101:bash.0 Request processed in 5995us (6141us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788592765.807553:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 191 00000100:00100000:1.0:1788592765.810498:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592765.810718:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858496 00000100:00100000:2.0:1788592765.810731:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858496 00000100:00100000:2.0:1788592765.810800:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 192 00000100:00100000:2.0:1788592765.810812:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11066:x1875475136858496:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:2.0:1788592765.811164:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.811197:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.811211:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592765.811275:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788592765.811299:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae172424 reply state 0000000027223231 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.811308:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788592765.811391:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788592765.811512:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11066:x1875475136858496:12345-192.168.204.20@tcp:36:bash.0 Request processed in 701us (1028us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788592765.811534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 192 00000020:00080000:2.0:1788592765.813181:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788592765.819590:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1788592765.819661:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.819676:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.819684:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.819691:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592765.819698:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.819707:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.819728:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:1.0:1788592765.819732:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592765.819738:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.819753:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858624 00010000:00010000:1.0:1788592765.819764:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325116f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592765.819768:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858624 00000100:00100000:2.0:1788592765.819834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:2.0:1788592765.819847:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11066:x1875475136858624:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592765.819951:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592765.819973:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325116f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1c9d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.821467:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325116f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c9d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.821489:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325116f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c9d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.821513:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592765.821517:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788592765.821520:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:3.0:1788592765.821610:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11066:x1875475136858624:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1764us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.821646:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 193 00000100:00100000:1.0:1788592765.826685:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592765.830372:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858752 00000100:00100000:2.0:1788592765.830391:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858752 00000100:00100000:1.0:1788592765.831133:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:1.0:1788592765.831146:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:11066:x1875475136858752:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592765.831181:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592765.831209:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ca4 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592765.831246:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bc278, atime: 0x6a9bc276, ctime: 0x6a9bc278, blocks: 0xb 00010000:00010000:1.0:1788592765.831276:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788592765.831282:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592765.831292:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.831314:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.831328:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be000, rc 0) 00000100:00100000:1.0:1788592765.831431:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:11066:x1875475136858752:12345-192.168.204.20@tcp:101:bash.0 Request processed in 288us (4761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.831439:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00080000:3.0:1788592765.831820:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592765.836371:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592765.836849:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136858880 00000100:00100000:2.0:1788592765.836880:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136858880 00002000:00010000:2.0:1788592765.836936:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788592765.836942:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981c21d0700 with x1875475136858880 ext(0->18446744073709551615) 00002000:00010000:2.0:1788592765.836958:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981c21d0700. 00000100:00100000:2.0:1788592765.837040:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:2.0:1788592765.837053:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136858880:12345-192.168.204.20@tcp:10:bash.0 00002000:00010000:2.0:1788592765.837452:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788592765.837457:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788592760 -> 1788592765 00002000:00010000:2.0:1788592765.837461:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788592758 -> 1788592758 00002000:00010000:2.0:1788592765.837463:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788592760 -> 1788592765 00002000:00010000:2.0:1788592765.837466:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788592765.837548:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136858880:12345-192.168.204.20@tcp:10:bash.0 Request processed in 496us (1209us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788592765.837556:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00002000:00010000:2.0:1788592765.837560:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788592765.837563:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981c21d0700 with x1875475136858880 ext(0->18446744073709551615) 00002000:00010000:2.0:1788592765.837568:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8981c21d0700. 00000100:00100000:1.0:1788592765.911918:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592765.912182:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859008 00000100:00100000:3.0:1788592765.912196:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859008 00000100:00100000:3.0:1788592765.912270:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:3.0:1788592765.912283:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11555:x1875475136859008:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:3.0:1788592765.912421:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912443:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912456:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912474:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912481:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912488:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912786:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912797:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912805:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592765.912859:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912873:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912881:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912889:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912895:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592765.912900:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912909:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912924:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592765.912927:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592765.912933:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912940:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511705 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912957:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912964:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912975:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912981:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592765.912984:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912990:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.912998:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a03de300) 00010000:00010000:3.0:1788592765.913001:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592765.913003:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913010:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251170c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913309:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913317:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913324:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913330:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592765.913333:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913426:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913438:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592765.913441:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592765.913445:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.913452:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592765.914432:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11555:x1875475136859008:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 2137us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592765.914447:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 194 00000100:00100000:0.0:1788592765.929096:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592765.929147:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592765.929203:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592765.929403:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859392 00000100:00100000:1.0:1788592765.929417:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859392 00000100:00100000:1.0:1788592765.929500:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:1.0:1788592765.929511:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136859392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592765.929614:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136859392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 104us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.929638:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 165 00000100:00100000:2.0:1788592765.929863:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859264 00000100:00100000:2.0:1788592765.929869:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859264 00000100:00100000:2.0:1788592765.929918:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1788592765.929927:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136859264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592765.929963:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136859264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592765.929970:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:3.0:1788592765.930436:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859136 00000100:00100000:3.0:1788592765.930443:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859136 00000100:00100000:3.0:1788592765.930528:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:3.0:1788592765.930537:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136859136:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592765.930592:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136859136:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 57us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.930599:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00080000:0.0:1788592765.930812:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592765.930818:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592765.969922:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592765.970154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859648 00000100:00100000:2.0:1788592765.970179:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859648 00000100:00100000:2.0:1788592765.970270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1788592765.970281:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+32:11558:x1875475136859648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592765.970310:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592765.970337:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f13251171a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cab expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970481:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970500:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970515:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970530:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970538:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.970546:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971404:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251172f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971420:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251172f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971430:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251172f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592765.971455:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788592765.971581:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971591:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971598:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971605:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592765.971611:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971620:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971636:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592765.971640:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592765.971658:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971666:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511721 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971679:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971685:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971702:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971707:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592765.971710:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971717:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971725:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a1fe1600) 00010000:00010000:2.0:1788592765.971728:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592765.971731:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.971736:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511728 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.974393:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f13251171a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cab expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.974435:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251172f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cab expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592765.974446:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592765.974449:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788592765.974453:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5c00, rc 0) 00000100:00100000:3.0:1788592765.975411:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11558:x1875475136859648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 5119us (5489us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788592765.975426:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 195 00000100:00100000:2.0:1788592765.979071:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592765.979430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136859776 00000100:00100000:1.0:1788592765.979444:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136859776 00000100:00100000:1.0:1788592765.979518:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:1.0:1788592765.979530:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11558:x1875475136859776:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592765.979621:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.979653:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.979665:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.979713:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 34 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.979730:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 34 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.979747:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147336704:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592765.981535:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592765.988007:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592765.988149:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147336704:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592765.988198:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592765.992381:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136860032 00000100:00100000:0.0:1788592765.992404:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136860032 00000100:00100000:0.0:1788592765.992499:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:0.0:1788592765.992512:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:5583:x1875475136860032:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788592765.992965:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+36:5583:x1875475136860032:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 452us (4972us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788592765.992983:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:2.0:1788592765.998638:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592765.998745:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136860160 00000100:00100000:3.0:1788592765.998757:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136860160 00010000:00010000:3.0:1788592765.998817:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 36 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592765.998870:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:3.0:1788592765.998882:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+36:2344:x1875475136860160:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592765.998903:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592765.998912:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 36 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.998928:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 36 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.998957:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbe00/0x27b316f1325116e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c96 expref: 36 pid: 5824 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.998988:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592765.998995:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.999007:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.999016:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592765.999055:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592765.999120:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+35:2344:x1875475136860160:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 240us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592765.999128:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00010000:00010000:1.0:1788592765.999282:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999293:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999331:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999339:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999345:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999385:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592765.999391:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999400:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999411:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:1.0:1788592765.999415:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592765.999419:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592765.999426:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f13251173d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592765.999486:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11558:x1875475136859776:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 19957us (20483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592765.999495:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 196 00000100:00100000:2.0:1788592766.007717:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.007943:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136860416 00000100:00100000:3.0:1788592766.007957:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136860416 00000100:00100000:3.0:1788592766.008198:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:3.0:1788592766.008211:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+34:11558:x1875475136860416:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592766.008555:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11558:x1875475136860416:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 346us (852us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788592766.008564:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1788592766.124899:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592766.125147:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136860672 00000100:00100000:2.0:1788592766.125171:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136860672 00000100:00100000:2.0:1788592766.125243:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:2.0:1788592766.125255:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+35:11569:x1875475136860672:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1788592766.125288:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592766.125314:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cb2 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125452:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125470:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125484:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125501:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125508:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.125515:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126260:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511759 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126274:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126296:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592766.126309:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788592766.126455:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126464:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126472:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126479:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592766.126484:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126493:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126508:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592766.126511:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592766.126518:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126524:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5200/0x27b316f13251174b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126539:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126544:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126556:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126562:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592766.126565:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126572:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126581:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a1fe1600) 00010000:00010000:2.0:1788592766.126583:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592766.126586:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126592:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f132511752 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126663:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f132511744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb2 expref: 38 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126680:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb2 expref: 37 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.126689:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:2.0:1788592766.126691:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592766.126694:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f4200, rc 0) 00000100:00100000:2.0:1788592766.127345:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898193bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11569:x1875475136860672:12345-192.168.204.20@tcp:101:cat.0 Request processed in 2086us (2454us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788592766.127432:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 197 00000100:00100000:2.0:1788592766.134518:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.134820:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136860928 00000100:00100000:0.0:1788592766.134836:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136860928 00000100:00100000:0.0:1788592766.134906:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:0.0:1788592766.134918:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11569:x1875475136860928:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:0.0:1788592766.138119:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11569:x1875475136860928:12345-192.168.204.20@tcp:35:cat.0 Request processed in 3188us (3599us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788592766.138156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 54 00000100:00100000:0.0:1788592766.172415:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.172560:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136861184 00000100:00100000:3.0:1788592766.172572:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136861184 00000100:00100000:3.0:1788592766.173527:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 198 00000100:00100000:3.0:1788592766.173550:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11570:x1875475136861184:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1788592766.173652:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788592766.173693:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4200/0x27b316f132511759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb2 expref: 38 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173721:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251172f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cab expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173734:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325116f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c9d expref: 36 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173745:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff898185c2d600) 00010000:00010000:3.0:1788592766.173771:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592766.173801:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173818:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173849:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173867:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173875:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.173882:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.174299:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.174310:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.174318:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592766.175307:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788592766.175320:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340415969404ns, next at 341415966594ns, rc = 0 00010000:00010000:3.0:1788592766.175419:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175432:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175441:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175460:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175466:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175473:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175634:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592766.175660:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175667:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175674:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175679:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.175684:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175693:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175709:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a03de800) 00010000:00010000:3.0:1788592766.175712:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788592766.175720:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.175737:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f132511775 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176087:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176097:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176103:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176108:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.176111:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176118:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176127:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592766.176130:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.176133:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.176139:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511767 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592766.176152:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e091c92 reply state 00000000e4c030ab transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.176171:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592766.178338:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+37:11570:x1875475136861184:12345-192.168.204.20@tcp:36:rm.0 Request processed in 4779us (5919us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788592766.178376:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 198 00010000:00010000:1.0:1788592766.189611:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592766.189633:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.189647:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592766.189653:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.189665:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.189689:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8981a03de800) 00010000:00010000:1.0:1788592766.189693:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788592766.189699:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.189706:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f13251177c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.189741:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592766.189743:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592766.189745:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592766.194508:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194531:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194564:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194570:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592766.194575:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194584:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194605:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a03de300) 00010000:00010000:1.0:1788592766.194607:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592766.194614:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.194621:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251176e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.206886:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592766.240744:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.240948:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136861440 00000100:00100000:3.0:1788592766.240972:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136861440 00000100:00100000:3.0:1788592766.241043:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:3.0:1788592766.241056:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+36:11576:x1875475136861440:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1788592766.241091:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592766.241121:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511783 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cb9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241299:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241317:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241331:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241390:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241399:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.241407:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592766.242245:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788592766.242577:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242593:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242605:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242651:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242659:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242665:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242671:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592766.242676:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242684:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242699:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:0.0:1788592766.242702:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592766.242719:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242727:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251178a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592766.242744:0:5822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000553b6bb reply state 000000001131bb62 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.242754:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592766.242795:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511783 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242812:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.242820:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.242837:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592766.242840:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592766.243013:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+39:11576:x1875475136861440:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1960us (2284us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788592766.243024:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 199 00000100:00100000:1.0:1788592766.258802:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592766.258905:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136861568 00000100:00100000:2.0:1788592766.258917:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136861568 00000100:00100000:2.0:1788592766.258987:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:2.0:1788592766.258999:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2343:x1875475136861568:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1788592766.259033:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592766.259060:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cc0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592766.259095:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592766.259119:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788592766.259125:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592766.259137:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.259174:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.259189:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592766.259416:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136861568:12345-192.168.204.20@tcp:101:bash.0 Request processed in 418us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592766.259439:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00010000:00010000:3.0:1788592766.259554:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259565:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259584:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259591:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.259596:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259606:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259623:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a03ded00) 00010000:00010000:3.0:1788592766.259626:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.259631:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.259638:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.267053:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.267332:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136861696 00000100:00100000:0.0:1788592766.267345:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136861696 00000100:00100000:0.0:1788592766.267440:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1788592766.267450:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+6:11576:x1875475136861696:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592766.267474:0:8688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592766.267497:0:8688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cc7 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.267551:0:8688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.267561:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592766.267566:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592766.267572:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.267615:0:8688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.267631:0:8688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 7 pid: 6676 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.267648:0:8688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8688:1875475147336832:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592766.267769:0:8688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981816820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592766.273795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.273904:0:8688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8688:1875475147336832:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592766.273949:0:8688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.273980:0:8688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccaa00, rc 0) 00000100:00100000:2.0:1788592766.274276:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136861824 00000100:00100000:2.0:1788592766.274285:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136861824 00010000:00010000:2.0:1788592766.274327:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 8 pid: 6676 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.276681:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:2.0:1788592766.276713:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136861824:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592766.276741:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592766.276782:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 8 pid: 6676 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.276804:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 8 pid: 6676 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.276833:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bc94dd5/0x27b316f1325117a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc0 expref: 8 pid: 6676 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.276854:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592766.276859:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592766.276870:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.276882:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.276954:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.276970:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898182840a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147336960:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592766.277438:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff898190089240 going to sleep for 11 seconds 00000100:00100000:0.0:1788592766.278953:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:11576:x1875475136861696:12345-192.168.204.20@tcp:101:bash.0 Request processed in 11490us (11902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592766.278969:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:3.0:1788592766.287849:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.287993:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898182840a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5808:1875475147336960:192.168.204.20@tcp:105: 00010000:00010000:1.0:1788592766.288041:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592766.288114:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2344:x1875475136861824:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 11415us (14334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.288128:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 74 00000100:00100000:0.0:1788592766.288282:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862080 00000100:00100000:0.0:1788592766.288291:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862080 00000100:00100000:0.0:1788592766.288378:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:0.0:1788592766.288390:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+38:11576:x1875475136862080:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:1.0:1788592766.289932:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+39:11576:x1875475136862080:12345-192.168.204.20@tcp:35:bash.0 Request processed in 1533us (2087us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788592766.289946:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 55 00000100:00100000:3.0:1788592766.447460:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.447636:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862208 00000100:00100000:1.0:1788592766.447651:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862208 00000100:00100000:1.0:1788592766.447733:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:1.0:1788592766.447745:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+39:11592:x1875475136862208:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592766.447781:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592766.447812:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f1325117b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cce expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.447916:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.447937:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.447953:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592766.448000:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788592766.448004:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592766.448025:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.448054:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f1325117b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cce expref: 41 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.448076:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cce expref: 40 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.448086:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592766.448089:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592766.448112:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfc00, rc 0) 00000100:00100000:1.0:1788592766.448194:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+40:11592:x1875475136862208:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 451us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.448201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 200 00000100:00100000:1.0:1788592766.451889:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592766.451980:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862464 00000100:00100000:2.0:1788592766.451994:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862464 00000100:00100000:2.0:1788592766.452117:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:2.0:1788592766.452129:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+40:11592:x1875475136862464:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592766.452167:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592766.452195:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325117c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cd5 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.452325:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325117c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.452343:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325117c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.452382:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325117c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592766.452396:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788592766.452566:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325117c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cd5 expref: 43 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.452587:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325117c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cd5 expref: 42 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.452617:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:2.0:1788592766.452620:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592766.452624:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5a00, rc 0) 00000100:00100000:2.0:1788592766.452704:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+42:11592:x1875475136862464:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 577us (831us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788592766.452712:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 201 00000100:00100000:3.0:1788592766.455268:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.455343:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.455415:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862848 00000100:00100000:1.0:1788592766.455428:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862848 00000100:00100000:1.0:1788592766.455495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:1.0:1788592766.455506:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+42:11592:x1875475136862848:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592766.455539:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592766.455564:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325117d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cdc expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.455696:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.455714:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.455728:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592766.455741:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788592766.455908:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f1325117d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cdc expref: 45 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.455929:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cdc expref: 44 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.455938:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:1.0:1788592766.455954:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788592766.455959:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf000, rc 0) 00000100:00100000:1.0:1788592766.456053:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+44:11592:x1875475136862848:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 548us (708us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788592766.456062:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 202 00000100:00100000:0.0:1788592766.456520:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862592 00000100:00100000:0.0:1788592766.456528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862592 00000100:00100000:0.0:1788592766.456583:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:0.0:1788592766.456592:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+44:2344:x1875475136862592:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592766.456606:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592766.456636:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325117c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cd5 expref: 44 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.456650:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.456655:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592766.456691:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+43:2344:x1875475136862592:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 101us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592766.456699:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592766.464800:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.465404:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136862976 00000100:00100000:1.0:1788592766.465417:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136862976 00000100:00100000:1.0:1788592766.465480:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:1.0:1788592766.465490:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+6:2343:x1875475136862976:12345-192.168.204.20@tcp:1:lfs.0 00010000:00010000:1.0:1788592766.465545:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.465568:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 6 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.465577:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592766.465582:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592766.465588:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.465632:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 6 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.465648:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 6 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.465663:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875475147337088:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592766.465791:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592766.471725:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.472168:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136863104 00000100:00100000:0.0:1788592766.472183:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136863104 00002000:00100000:0.0:1788592766.472256:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8981bc7cf800 x1875475136863104/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:42/0 lens 504/0 e 0 to 0 dl 1788592777 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592766.472268:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc7cf800 with x1875475136863104 ext(0->8) 00010000:00010000:0.0:1788592766.472280:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.472301:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 7 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592766.472338:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bc7cf800 00000100:00100000:0.0:1788592766.472406:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:0.0:1788592766.472417:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136863104:12345-192.168.204.20@tcp:4:lfs.0 00000100:00100000:2.0:1788592766.473526:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875475147337088:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592766.473562:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.473813:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2344:x1875475136863104:12345-192.168.204.20@tcp:4:lfs.0 Request processed in 1396us (2103us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788592766.475532:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00002000:00100000:0.0:1788592766.475555:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8981bc7cf800 x1875475136863104/t4294967308(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:42/0 lens 504/448 e 0 to 0 dl 1788592777 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592766.475568:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8981bc7cf800 with x1875475136863104 ext(0->8) 00010000:00010000:0.0:1788592766.475582:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.475605:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788592766.475615:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8981bc7cf800 00000100:00100000:3.0:1788592766.479223:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.479850:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136863232 00000100:00100000:1.0:1788592766.479865:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136863232 00010000:00010000:1.0:1788592766.479936:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.479993:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:1.0:1788592766.480005:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2344:x1875475136863232:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592766.480168:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788592766.480198:0:11159:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788592766.480202:0:11159:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788592765 00002000:00010000:1.0:1788592766.480204:0:11159:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788592765 00002000:00010000:1.0:1788592766.480208:0:11159:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788592765 00010000:00010000:1.0:1788592766.480216:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.480232:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.480260:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d2089a4/0x27b316f1325117ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cc7 expref: 9 pid: 8688 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.480281:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592766.480287:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788592766.480294:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.480327:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.480431:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592766.480505:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136863232:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 502us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.480514:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00010000:00010000:2.0:1788592766.480840:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480852:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480894:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480903:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480912:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480933:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592766.480939:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480949:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480963:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.480972:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000353ee99a/0x27b316f1325117ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.481040:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136862976:12345-192.168.204.20@tcp:1:lfs.0 Request processed in 15551us (16257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592766.481049:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1788592766.485264:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.485945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136863488 00000100:00100000:0.0:1788592766.485960:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136863488 00000100:00100000:0.0:1788592766.486050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 56 00000100:00100000:0.0:1788592766.486062:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+43:11592:x1875475136863488:12345-192.168.204.20@tcp:35:lfs.0 00000004:00010000:0.0:1788592766.486149:0:5826:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cdc expref: 43 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592766.487945:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788592766.488045:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788592766.488514:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788592766.488592:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.488618:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.488628:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.488688:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 47 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.488708:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 47 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.488726:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147337216:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592766.488860:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf483600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592766.497303:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5826:1875475147337216:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592766.497365:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.498110:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.498338:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136863616 00000100:00100000:0.0:1788592766.498387:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136863616 00010000:00010000:0.0:1788592766.498444:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 48 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.498489:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:0.0:1788592766.498500:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+48:2343:x1875475136863616:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592766.498522:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592766.498530:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 48 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498564:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 48 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498591:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f132511798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cb9 expref: 48 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498610:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.498616:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498626:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498634:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.498665:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592766.498735:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+47:2343:x1875475136863616:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 236us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592766.498743:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00010000:00010000:3.0:1788592766.499188:0:5826:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.499199:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592766.499401:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788592766.499657:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788592766.500456:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147337344:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788592766.500546:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592766.500592:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db900 going to sleep for 11 seconds 00000100:00100000:1.0:1788592766.500876:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147337344 00000100:00100000:1.0:1788592766.500887:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147337344 00000100:00100000:1.0:1788592766.500977:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592766.500989:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147337344:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788592766.501250:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147337344:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 263us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.501258:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788592766.501452:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788592766.501836:0:5826:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788592766.501844:0:5826:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bca9f100, transno 4294967307 00000100:00100000:3.0:1788592766.501868:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147337344:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788592766.503497:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788592766.503620:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147337472:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788592766.503706:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592766.503756:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db000 going to sleep for 11 seconds 00000100:00100000:2.0:1788592766.504796:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147337472 00000100:00100000:2.0:1788592766.504812:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147337472 00000100:00100000:2.0:1788592766.504883:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592766.504895:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5826:x1875475147337472:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788592766.505228:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5826:x1875475147337472:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 333us (1519us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788592766.505238:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592766.505474:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e53480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5826:1875475147337472:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788592766.505572:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788592766.505634:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505648:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505681:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505688:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592766.505694:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505705:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505728:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.505732:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788592766.505738:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.505746:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f1325117f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592766.506677:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788592766.506838:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1788592766.506853:0:5826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340747502382ns, next at 341747498878ns, rc = 0 00000001:00080000:0.0:1788592766.506863:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788592766.506923:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.506938:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788592766.506949:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f1325117de lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cdc expref: 51 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.507108:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+50:11592:x1875475136863488:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 21047us (21858us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788592766.507136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 56 00000020:00080000:0.0:1788592766.507141:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788592766.510857:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.511118:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136863744 00000100:00100000:0.0:1788592766.511132:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136863744 00000100:00100000:0.0:1788592766.511227:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:0.0:1788592766.511239:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+50:11592:x1875475136863744:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592766.511274:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592766.511306:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f1325117fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ce3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.511420:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f1325117fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ce3 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.511438:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f1325117fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ce3 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.511461:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592766.511465:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592766.511469:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592766.511535:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+51:11592:x1875475136863744:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 298us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592766.511543:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 203 00000100:00100000:2.0:1788592766.515722:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.515855:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136864000 00000100:00100000:1.0:1788592766.515870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136864000 00000100:00100000:1.0:1788592766.515949:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1788592766.515962:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+51:11592:x1875475136864000:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592766.516300:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+52:11592:x1875475136864000:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 340us (591us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788592766.516309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 57 00000100:00100000:1.0:1788592766.609062:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.609225:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136864128 00000100:00100000:3.0:1788592766.609240:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136864128 00000100:00100000:3.0:1788592766.609318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:3.0:1788592766.609330:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+52:11602:x1875475136864128:12345-192.168.204.20@tcp:34:lfs.0 00010000:00010000:3.0:1788592766.609487:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609519:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609557:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609574:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609581:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609587:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609695:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609702:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609708:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788592766.609764:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609777:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609784:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609791:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609805:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.609810:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609818:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609833:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592766.609836:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.609842:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609848:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609864:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609871:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609877:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609882:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.609885:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609891:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609910:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a03ded00) 00010000:00010000:3.0:1788592766.609912:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.609915:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.609922:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610127:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610137:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610143:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610148:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.610159:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610165:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610174:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592766.610176:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.610180:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.610186:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f13251180f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.610477:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+52:11602:x1875475136864128:12345-192.168.204.20@tcp:34:lfs.0 Request processed in 1145us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592766.610486:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 204 00000100:00100000:2.0:1788592766.650245:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.650401:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136864384 00000100:00100000:0.0:1788592766.650416:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136864384 00000100:00100000:0.0:1788592766.650490:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:0.0:1788592766.650503:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+52:11605:x1875475136864384:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592766.650550:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592766.650577:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132511816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cea expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.650702:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.650722:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.650737:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.650995:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651127:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651138:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651306:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651316:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651323:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592766.651335:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788592766.651510:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651519:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651532:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651538:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592766.651543:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651552:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651567:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:0.0:1788592766.651571:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592766.651577:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651583:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251181d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651598:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651605:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651610:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651615:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592766.651906:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651914:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651922:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff898185c2de00) 00010000:00010000:0.0:1788592766.651925:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592766.651929:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651935:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.651990:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132511816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.652125:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.652135:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592766.652138:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592766.652140:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb600, rc 0) 00000100:00100000:0.0:1788592766.652296:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:11605:x1875475136864384:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1794us (2065us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788592766.652306:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 205 00000100:00100000:2.0:1788592766.656289:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.656495:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136864512 00000100:00100000:1.0:1788592766.656508:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136864512 00000100:00100000:1.0:1788592766.656615:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:1.0:1788592766.656660:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:11605:x1875475136864512:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592766.656763:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656786:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656799:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656835:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656843:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656852:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656859:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592766.656864:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656873:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656888:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.656891:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592766.656897:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.656904:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf400/0x27b316f132511839 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.657252:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+54:11605:x1875475136864512:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 360us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.657262:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 206 00000100:00100000:0.0:1788592766.659864:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.660527:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136864768 00000100:00100000:3.0:1788592766.660544:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136864768 00000100:00100000:3.0:1788592766.660617:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1788592766.660629:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+54:11605:x1875475136864768:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:3.0:1788592766.661220:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+55:11605:x1875475136864768:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 588us (1367us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788592766.661230:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 58 00000100:00100000:3.0:1788592766.745823:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.746003:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865024 00000100:00100000:0.0:1788592766.746024:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865024 00000100:00100000:0.0:1788592766.746099:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 207 00000100:00100000:0.0:1788592766.746130:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+55:11615:x1875475136865024:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592766.746172:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592766.746176:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788592766.746211:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfc00/0x27b316f1325117bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cce expref: 55 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746239:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:0.0:1788592766.746245:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592766.746263:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132511840 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cf1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746430:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746446:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746456:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746497:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.746511:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 55 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.746526:0:6700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147337600:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592766.746666:0:6700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf4833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592766.752474:0:6700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6700:1875475147337600:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592766.752522:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592766.754726:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.754809:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865152 00000100:00100000:1.0:1788592766.754821:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865152 00010000:00010000:1.0:1788592766.754886:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 56 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.754940:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:1.0:1788592766.754952:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+56:2343:x1875475136865152:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592766.754973:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592766.754982:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 56 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755016:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 56 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755046:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f13251182b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cea expref: 56 pid: 5822 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755068:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.755074:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755091:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755121:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.755167:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592766.755212:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.755221:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592766.755245:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:1.0:1788592766.755251:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+55:2343:x1875475136865152:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 302us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.755259:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00010000:00010000:3.0:1788592766.755553:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb400/0x27b316f132511840 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 56 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.755571:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 55 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.755578:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592766.755581:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788592766.755591:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca200, rc 0) 00000100:00100000:3.0:1788592766.755681:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+55:11615:x1875475136865024:12345-192.168.204.20@tcp:101:bash.0 Request processed in 9497us (9817us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788592766.755690:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 207 00000100:00100000:2.0:1788592766.760916:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.761160:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865408 00000100:00100000:3.0:1788592766.761172:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865408 00000100:00100000:3.0:1788592766.761274:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 208 00000100:00100000:3.0:1788592766.761286:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+55:11615:x1875475136865408:12345-192.168.204.20@tcp:36:bash.0 00010000:00010000:3.0:1788592766.761670:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.761697:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.761714:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592766.761777:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:3.0:1788592766.761798:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000539c85df reply state 000000007a35638d transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.761808:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592766.761931:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+58:11615:x1875475136865408:12345-192.168.204.20@tcp:36:bash.0 Request processed in 645us (1028us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788592766.761938:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 208 00000020:00080000:3.0:1788592766.761944:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788592766.765779:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.765803:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.765812:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.765818:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc213a4f0) 00000100:00100000:2.0:1788592766.766255:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1788592766.766408:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.766421:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.766442:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.766445:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592766.766451:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.766458:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.766757:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865536 00000100:00100000:0.0:1788592766.766772:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865536 00000100:00100000:0.0:1788592766.766842:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:0.0:1788592766.766854:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+57:11615:x1875475136865536:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592766.766891:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592766.766914:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251185c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cf8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.767253:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.767270:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 58 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.767281:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.767325:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 58 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.767341:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 58 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.767396:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147337728:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592766.767495:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf4833c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592766.771662:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.772332:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147337728:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592766.772419:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.772635:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865664 00000100:00100000:3.0:1788592766.772646:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865664 00010000:00010000:3.0:1788592766.772697:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 59 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.772765:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1788592766.772777:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+59:2344:x1875475136865664:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592766.772798:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592766.772806:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 59 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.772819:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 59 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.772937:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511847 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf1 expref: 59 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.772954:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592766.772959:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.772970:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.772978:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.773133:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592766.773279:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+58:2344:x1875475136865664:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 502us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592766.773287:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00010000:00010000:0.0:1788592766.773483:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.773492:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592766.773551:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788592766.773556:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592766.773582:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.773624:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f13251185c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.773641:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.773650:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592766.773652:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592766.773655:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca000, rc 0) 00000100:00100000:0.0:1788592766.773688:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+57:11615:x1875475136865536:12345-192.168.204.20@tcp:101:bash.0 Request processed in 6836us (7441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592766.773696:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 209 00000100:00100000:2.0:1788592766.778778:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.778837:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136865920 00000100:00100000:0.0:1788592766.778850:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136865920 00000100:00100000:0.0:1788592766.778922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:0.0:1788592766.778955:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+57:11615:x1875475136865920:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:0.0:1788592766.779323:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+58:11615:x1875475136865920:12345-192.168.204.20@tcp:35:bash.0 Request processed in 369us (557us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788592766.779332:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 59 00000100:00100000:1.0:1788592766.841261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592766.842211:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866048 00000100:00100000:2.0:1788592766.842228:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866048 00000100:00100000:2.0:1788592766.842384:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:2.0:1788592766.842396:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+58:11621:x1875475136866048:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592766.842433:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592766.842460:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251186a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1cff expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842547:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842567:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842581:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592766.842636:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788592766.842640:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592766.842662:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842716:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5c00/0x27b316f13251186a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cff expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842738:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cff expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.842821:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592766.842825:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592766.842830:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:2.0:1788592766.842911:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136866048:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 517us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592766.842918:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:0.0:1788592766.846871:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.846974:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866176 00000100:00100000:3.0:1788592766.847117:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866176 00000100:00100000:3.0:1788592766.847236:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:3.0:1788592766.847250:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136866176:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592766.847282:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592766.847310:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d06 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847429:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847448:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847463:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847484:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847492:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847499:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847638:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847647:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847654:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592766.847711:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788592766.847716:0:6700:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592766.847742:0:6700:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847899:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847910:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847917:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847925:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847931:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.847936:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847944:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847958:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:3.0:1788592766.847961:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.847967:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.847973:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f13251187f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848079:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848087:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848093:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848098:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592766.848101:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848108:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848116:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8981a03ded00) 00010000:00010000:3.0:1788592766.848119:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592766.848122:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848127:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9000/0x27b316f132511886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848176:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848192:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 60 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.848212:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592766.848215:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592766.848218:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:3.0:1788592766.848383:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11621:x1875475136866176:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1137us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592766.848391:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 211 00000100:00100000:0.0:1788592766.853032:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592766.853081:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.853222:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866432 00000100:00100000:3.0:1788592766.853234:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866432 00000100:00100000:3.0:1788592766.853306:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:3.0:1788592766.853318:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11621:x1875475136866432:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592766.853346:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592766.853403:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511894 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d0d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853537:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853553:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853561:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853570:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853614:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.853882:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.853900:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147337856:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592766.854113:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592766.854123:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592766.854134:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147337984:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592766.854174:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905dbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592766.854927:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866560 00000100:00100000:1.0:1788592766.854936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866560 00010000:00010000:1.0:1788592766.854975:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 62 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.855023:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:1.0:1788592766.855035:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+62:2342:x1875475136866560:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592766.855048:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592766.855055:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 62 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.855069:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 62 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.855094:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.855100:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.855110:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.855117:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592766.855178:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+62:2342:x1875475136866560:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 145us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.855185:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00010000:00010000:1.0:1788592766.859527:0:5824:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.20@tcp) returned -22 from blocking AST (req@000000001f543b58 x1875475147337856) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.859577:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251188d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d06 expref: 61 pid: 6700 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.859604:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147337856:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592766.860557:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592766.860915:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866688 00000100:00100000:3.0:1788592766.860927:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866688 00010000:00010000:3.0:1788592766.860979:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592766.861040:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:3.0:1788592766.861050:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+61:2343:x1875475136866688:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592766.861074:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592766.861080:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.861095:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 61 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.861122:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592766.861129:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.861143:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.861162:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592766.861210:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592766.861482:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+61:2343:x1875475136866688:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 432us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592766.861491:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00010000:00010000:1.0:1788592766.862396:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511863 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cf8 expref: 60 pid: 5822 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592766.862420:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc187800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147337984:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592766.862453:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.862462:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.862474:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.862480:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592766.862505:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788592766.862723:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511894 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 61 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.862743:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 60 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.862895:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.862914:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592766.862917:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ea00, rc 0) 00000100:00100000:1.0:1788592766.862975:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11621:x1875475136866432:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 9659us (9969us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788592766.862983:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 212 00000100:00100000:0.0:1788592766.866490:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.866587:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136866944 00000100:00100000:1.0:1788592766.866600:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136866944 00000100:00100000:1.0:1788592766.866856:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:1.0:1788592766.866870:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11621:x1875475136866944:12345-192.168.204.20@tcp:103:lfs.0 00010000:00010000:1.0:1788592766.866891:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592766.866924:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccba00/0x27b316f1325117fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ce3 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.866946:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.866952:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592766.867164:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136866944:12345-192.168.204.20@tcp:103:lfs.0 Request processed in 296us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.867173:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592766.870531:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592766.870643:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867072 00000100:00100000:2.0:1788592766.870656:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867072 00000100:00100000:2.0:1788592766.870730:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:2.0:1788592766.870742:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136867072:12345-192.168.204.20@tcp:58:lfs.0 00010000:00010000:2.0:1788592766.871184:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.871205:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592766.871218:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592766.871557:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788592766.871815:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136867072:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 1071us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592766.871844:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 213 00000100:00100000:2.0:1788592766.874675:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592766.874839:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867200 00000100:00100000:1.0:1788592766.874854:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867200 00000100:00100000:1.0:1788592766.874960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 214 00000100:00100000:1.0:1788592766.874971:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+59:11621:x1875475136867200:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592766.875017:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592766.875049:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d14 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875135:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875177:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875204:0:5823:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875223:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875240:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592766.875244:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592766.875248:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592766.875257:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bea00, rc 0) 00000100:00100000:1.0:1788592766.875331:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11621:x1875475136867200:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 362us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592766.875339:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 214 00010000:00010000:1.0:1788592767.231778:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788592767.742710:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788592767.742726:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592767.742796:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788592767.742805:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592767.743147:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e51c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147338112:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788592767.743338:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.758629:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592767.759588:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867328 00000100:00100000:0.0:1788592767.759602:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867328 00000100:00100000:0.0:1788592767.759711:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00100000:0.0:1788592767.759726:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136867328:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788592767.759778:0:6700:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788592767.759920:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136867328:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 200us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.759929:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 215 00000100:00080000:1.0:1788592767.760086:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592767.764236:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e51c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147338112:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788592767.775307:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592767.783939:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867456 00000100:00100000:1.0:1788592767.783962:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867456 00000100:00100000:1.0:1788592767.784114:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:1.0:1788592767.784126:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11622:x1875475136867456:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788592767.784235:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784280:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784297:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784326:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784335:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784342:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784394:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784403:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784409:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592767.784455:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788592767.784459:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592767.784475:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784487:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784504:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784512:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784518:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592767.784523:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784532:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784546:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:1.0:1788592767.784549:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592767.784554:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784560:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325118b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784576:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784582:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784588:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784593:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592767.784602:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784609:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784618:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff89818289ae00) 00010000:00010000:1.0:1788592767.784620:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592767.784623:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784629:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325118be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784646:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784651:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784656:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784661:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592767.784663:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784668:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784675:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592767.784677:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592767.784687:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.784694:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325118c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592767.784808:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11622:x1875475136867456:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 683us (9517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.784828:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 216 00000100:00100000:3.0:1788592767.798116:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592767.798404:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867712 00000100:00100000:0.0:1788592767.798418:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867712 00000100:00100000:0.0:1788592767.798485:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:0.0:1788592767.798495:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+60:11622:x1875475136867712:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592767.798523:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592767.798551:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325118cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d1b expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798685:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798705:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798720:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592767.798733:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788592767.798876:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798885:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798891:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798897:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592767.798902:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798910:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798941:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592767.798944:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592767.798950:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.798958:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f1325118d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.799006:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325118cc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d1b expref: 62 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.799017:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:0.0:1788592767.799020:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592767.799024:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f1325118cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d1b expref: 62 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.799034:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592767.799118:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136867712:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 624us (1017us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788592767.799126:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 217 00000100:00100000:0.0:1788592767.806387:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.806493:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136867840 00000100:00100000:2.0:1788592767.806507:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136867840 00000100:00100000:2.0:1788592767.806568:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:2.0:1788592767.806579:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136867840:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592767.806628:0:5823:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592767.806780:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136867840:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 202us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.806789:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 218 00000100:00100000:0.0:1788592767.819406:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592767.820643:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868096 00000100:00100000:3.0:1788592767.820661:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868096 00000100:00100000:2.0:1788592767.821030:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:2.0:1788592767.821044:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136868096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592767.821084:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592767.821091:0:6700:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788592767.821157:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f132511871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1cff expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.821190:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592767.821200:0:6700:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592767.821224:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d22 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788592767.822287:0:6700:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788592767.823302:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325118e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.823345:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325118e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.823527:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325118e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.823623:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d22 expref: 63 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.823648:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325118e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d22 expref: 62 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.823660:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:2.0:1788592767.823663:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592767.823668:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5a00, rc 0) 00000100:00100000:2.0:1788592767.826010:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898197777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+62:11622:x1875475136868096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4951us (6601us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788592767.826028:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 219 00000100:00100000:3.0:1788592767.841774:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.841938:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868352 00000100:00100000:2.0:1788592767.841952:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868352 00000100:00100000:2.0:1788592767.842037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:2.0:1788592767.842049:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+62:11622:x1875475136868352:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592767.842173:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592767.842209:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f1325118e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d22 expref: 62 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842231:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a1fe1600) 00010000:00010000:2.0:1788592767.842252:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592767.842278:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842295:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842307:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842422:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842431:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842439:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842522:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842530:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842538:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842545:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592767.842550:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842559:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842575:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:2.0:1788592767.842578:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592767.842582:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842589:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f1325118f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842598:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842605:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842611:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842617:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592767.842620:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842626:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842634:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8b010f61 (ffff8981a1fe1e00) 00010000:00010000:2.0:1788592767.842636:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592767.842639:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.842645:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5000/0x27b316f1325118fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8b010f61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.842759:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136868352:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 711us (1002us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788592767.842767:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 220 00000100:00100000:1.0:1788592767.862460:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592767.862597:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868480 00000100:00100000:3.0:1788592767.862611:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868480 00000100:00100000:3.0:1788592767.862697:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:3.0:1788592767.862708:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+61:11622:x1875475136868480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592767.866316:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592767.866393:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511904 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d29 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866452:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866471:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866506:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866643:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511904 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 63 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866672:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 62 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.866682:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:3.0:1788592767.866686:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788592767.866691:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:3.0:1788592767.866825:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+62:11622:x1875475136868480:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 4116us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592767.866836:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 221 00000100:00100000:3.0:1788592767.874670:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.874808:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868736 00000100:00100000:2.0:1788592767.874822:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868736 00000100:00100000:2.0:1788592767.874900:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:2.0:1788592767.874911:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+62:11622:x1875475136868736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592767.875048:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.875070:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.875084:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592767.876601:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1788592767.876623:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342117272731ns, next at 343117267726ns, rc = 0 00000004:00010000:2.0:1788592767.877677:0:5823:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cff1a73c reply state 000000007638aa27 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.877696:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788592767.877950:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+64:11622:x1875475136868736:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 3026us (3282us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788592767.877961:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 222 00000100:00100000:2.0:1788592767.892146:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1788592767.892328:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892343:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892396:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892403:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592767.892409:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892439:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892462:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:3.0:1788592767.892466:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788592767.892473:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.892479:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4000/0x27b316f132511912 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592767.898732:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868864 00000100:00100000:0.0:1788592767.898885:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868864 00000100:00100000:0.0:1788592767.899041:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:0.0:1788592767.899055:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+63:11622:x1875475136868864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592767.899091:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592767.899153:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d30 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.899254:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 64 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.899273:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 64 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592767.899298:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:0.0:1788592767.899302:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592767.899306:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca600, rc 0) 00000100:00100000:0.0:1788592767.899466:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+64:11622:x1875475136868864:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 414us (7346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.899474:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 223 00000100:00100000:1.0:1788592767.904293:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592767.904477:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136868992 00000100:00100000:3.0:1788592767.904491:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136868992 00000100:00100000:3.0:1788592767.904570:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1788592767.904581:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2341:x1875475136868992:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788592767.905396:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2341:x1875475136868992:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 812us (1114us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788592767.905406:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00080000:1.0:1788592767.905586:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592767.927081:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592767.927206:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136869248 00000100:00100000:0.0:1788592767.927220:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136869248 00000100:00100000:0.0:1788592767.927290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:0.0:1788592767.927304:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+64:11622:x1875475136869248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592767.927746:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+65:11622:x1875475136869248:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 442us (679us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788592767.927755:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 60 00000100:00100000:2.0:1788592767.932099:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592767.932276:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136869504 00000100:00100000:1.0:1788592767.932289:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136869504 00000100:00100000:1.0:1788592767.932414:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:1.0:1788592767.932426:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+65:11622:x1875475136869504:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788592767.932580:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+65:11622:x1875475136869504:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 156us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.932588:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 224 00000100:00100000:1.0:1788592767.940017:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592767.940471:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136869632 00000100:00100000:3.0:1788592767.940486:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136869632 00000100:00100000:3.0:1788592767.940566:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:3.0:1788592767.940578:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+65:11622:x1875475136869632:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592767.940605:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592767.940633:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511920 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d37 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.941108:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.941930:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.941950:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592767.942017:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592767.942044:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.942090:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fe00/0x27b316f132511920 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d37 expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.942115:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d37 expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592767.942135:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:3.0:1788592767.942139:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788592767.942144:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e9800, rc 0) 00000100:00100000:0.0:1788592767.943458:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+66:11622:x1875475136869632:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 2862us (3436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.943473:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 225 00000100:00100000:3.0:1788592767.956222:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592767.957110:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136869760 00000100:00100000:1.0:1788592767.957136:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136869760 00000100:00100000:1.0:1788592767.957233:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1788592767.957245:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+10:2341:x1875475136869760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592767.957273:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592767.957306:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d3e expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788592767.957699:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc27f, blocks: 0x1 00010000:00010000:1.0:1788592767.957748:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1788592767.957754:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592767.957768:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.957795:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592767.957814:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf200, rc 0) 00000100:00100000:1.0:1788592767.957905:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+11:2341:x1875475136869760:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 661us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592767.957914:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:1.0:1788592767.960871:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592767.961699:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870016 00000100:00100000:0.0:1788592767.961716:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870016 00000100:00100000:0.0:1788592767.961824:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:0.0:1788592767.961836:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+66:11622:x1875475136870016:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788592767.961988:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+66:11622:x1875475136870016:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 154us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592767.961997:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 226 00000100:00100000:0.0:1788592767.966455:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.966599:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870144 00000100:00100000:2.0:1788592767.966614:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870144 00000100:00100000:2.0:1788592767.966684:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:2.0:1788592767.966696:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+11:11622:x1875475136870144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592767.966721:0:8688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592767.966756:0:8688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d45 expref: -99 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.966798:0:8688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.966809:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592767.966814:0:8688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592767.966820:0:8688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 12 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.966867:0:8688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.966885:0:8688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.966903:0:8688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8688:1875475147338240:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592767.967036:0:8688:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a49d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.970450:0:8688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8688:1875475147338240:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592767.970503:0:8688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 12 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.970552:0:8688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5200, rc 0) 00000100:00100000:2.0:1788592767.970643:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+12:11622:x1875475136870144:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 3949us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.970653:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1788592767.979474:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.980415:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870272 00000100:00100000:2.0:1788592767.980431:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870272 00010000:00010000:2.0:1788592767.980493:0:5810:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.980548:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1788592767.980560:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2344:x1875475136870272:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592767.980580:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592767.980614:0:5810:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.980631:0:5810:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.980661:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024c375aa/0x27b316f13251192e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d3e expref: 12 pid: 6676 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.980684:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592767.980690:0:5810:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592767.980701:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 11 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.980734:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 11 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592767.980789:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 11 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592767.980808:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1875475147338368:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592767.980916:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff898084a49d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592767.989109:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5810:1875475147338368:192.168.204.20@tcp:105: 00010000:00010000:2.0:1788592767.989169:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592767.989265:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+11:2344:x1875475136870272:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 8705us (9807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592767.989284:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1788592767.990703:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592767.998842:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870400 00000100:00100000:2.0:1788592767.998866:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870400 00002000:00100000:0.0:1788592767.999040:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff898086e53b80 x1875475136870400/t0(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:43/0 lens 504/0 e 0 to 0 dl 1788592778 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592767.999054:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898086e53b80 with x1875475136870400 ext(0->12) 00002000:00010000:0.0:1788592767.999063:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898086e53b80 00000100:00100000:0.0:1788592767.999111:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1788592767.999123:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+11:2343:x1875475136870400:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788592768.001224:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2343:x1875475136870400:12345-192.168.204.20@tcp:4:lhsmtool_posix.0 Request processed in 2005us (10436us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788592768.001242:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00002000:00100000:1.0:1788592768.001259:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff898086e53b80 x1875475136870400/t4294967320(0) o4->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:43/0 lens 504/448 e 0 to 0 dl 1788592778 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788592768.001269:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898086e53b80 with x1875475136870400 ext(0->12) 00002000:00010000:1.0:1788592768.001277:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898086e53b80 00000100:00100000:0.0:1788592768.020842:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592768.021010:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870528 00000100:00100000:2.0:1788592768.021027:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870528 00000100:00100000:2.0:1788592768.021118:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 227 00000100:00100000:2.0:1788592768.021143:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+66:11622:x1875475136870528:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788592768.116470:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+66:11622:x1875475136870528:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 95313us (95630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592768.116488:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 227 00000001:00080000:0.0:1788592768.116647:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788592768.116672:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788592768.116768:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788592768.116822:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff898185236600 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788592768.116827:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898184f94000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff898185236840 00000020:00080000:0.0:1788592768.116830:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff898184f94400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8981bc1bc000 00000020:00080000:0.0:1788592768.116854:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8981905db900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788592768.116857:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981884cac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8981905dbe40 00000020:00080000:0.0:1788592768.116860:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981884ca200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89808421a800 00000004:00080000:0.0:1788592768.116869:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788592768.117074:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788592768.117324:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788592768.117377:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147338496:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788592768.117457:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592768.117532:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592768.117538:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147338624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788592768.117562:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592768.117599:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147338496 00000100:00100000:0.0:1788592768.117608:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147338496 00000100:00100000:0.0:1788592768.117660:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147338624 00000100:00100000:0.0:1788592768.117664:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147338624 00000100:00100000:0.0:1788592768.117684:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788592768.117693:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3283:x1875475147338496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788592768.117727:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788592768.117760:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.117788:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.117799:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788592768.117804:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788592768.117809:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.117847:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.117878:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 12 pid: 6676 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.117890:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875475147338752:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592768.117945:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf4830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592768.117962:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788592768.117970:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3283:x1875475147338624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788592768.118134:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788592768.118138:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788592767 00002000:00010000:0.0:1788592768.118141:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788592768.118143:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788592767 -> 1788592767 00002000:00010000:0.0:1788592768.118146:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788592768.118191:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3283:x1875475147338624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 221us (627us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788592768.118199:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788592768.118225:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788592768.118272:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff898184e5b100/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788592768.118279:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147338624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788592768.119649:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788592768.119673:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147338880:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788592768.119763:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592768.120065:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147338880 00000100:00100000:2.0:1788592768.120075:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147338880 00000100:00100000:2.0:1788592768.120162:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592768.120170:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1875475147338880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788592768.120199:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1788592768.120236:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9bc27d, atime: 0x6a9bc27d, ctime: 0x6a9bc27d, blocks: 0x1 00010000:00010000:2.0:1788592768.120244:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.120263:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788592768.120268:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592768.120277:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.120298:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.120321:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.120330:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.120371:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592768.121511:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592768.121527:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.121542:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592768.121547:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.121559:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.121585:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.121594:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021eb7c3e/0x27b316f132511943 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.121618:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592768.121620:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592768.121621:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788592768.121788:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592768.121970:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1875475147338880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1797us (2203us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788592768.121988:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592768.122651:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592768.122854:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085892300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875475147338752:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592768.122891:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.123082:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592768.123333:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870784 00000100:00100000:3.0:1788592768.123342:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870784 00010000:00010000:3.0:1788592768.123419:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 13 pid: 6676 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592768.123468:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1788592768.123478:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+13:2343:x1875475136870784:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592768.123497:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592768.123503:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 13 pid: 6676 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123518:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 13 pid: 6676 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123545:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003202d462/0x27b316f1325116fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ca4 expref: 13 pid: 6676 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123564:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592768.123569:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592768.123577:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123588:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123623:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592768.123682:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2343:x1875475136870784:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 204us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592768.123689:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00010000:00010000:3.0:1788592768.123724:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123748:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123760:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123768:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.123791:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788592768.124565:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136870656 00000100:00100000:0.0:1788592768.124577:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136870656 00000100:00100000:0.0:1788592768.124629:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1788592768.124639:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+12:2344:x1875475136870656:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788592768.126650:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3283:x1875475147338496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8949us (9185us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788592768.126664:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1788592768.127016:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff898184e58a80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788592768.127024:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147338496:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788592768.130012:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8981bd15dc00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788592768.130039:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147338880:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788592768.143011:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592768.143045:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.143061:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592768.143068:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.143082:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.143109:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.143116:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97c906e/0x27b316f13251193c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.143160:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592768.143162:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592768.143164:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788592768.206977:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1788592768.207007:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788592768.207149:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1788592768.207531:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981ba575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136870656:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 82885us (84877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592768.207545:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:2.0:1788592768.211164:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.211619:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871040 00000100:00100000:0.0:1788592768.211643:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871040 00000100:00100000:0.0:1788592768.211709:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 228 00000100:00100000:0.0:1788592768.211823:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11622:x1875475136871040:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788592768.211896:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592768.211943:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9800/0x27b316f132511927 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d37 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.211966:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:0.0:1788592768.211973:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592768.212013:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.212029:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.212040:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592768.212928:0:5824:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7ecfb83 reply state 000000009dc5923c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.212947:0:5824:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592768.213098:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+21:11622:x1875475136871040:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1375us (1947us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788592768.213107:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 228 00010000:00010000:0.0:1788592768.215874:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215898:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215907:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215913:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592768.215938:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215949:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215971:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:0.0:1788592768.215974:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592768.215980:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.215987:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f13251194a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.216791:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.217035:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871168 00000100:00100000:0.0:1788592768.217047:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871168 00000100:00100000:0.0:1788592768.217114:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1788592768.217138:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2343:x1875475136871168:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592768.217568:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788592768.217573:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788592767 -> 1788592765 00002000:00010000:0.0:1788592768.217576:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788592765 00002000:00010000:0.0:1788592768.217578:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788592767 -> 1788592765 00002000:00010000:0.0:1788592768.217581:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788592768.217709:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2343:x1875475136871168:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 583us (925us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788592768.217718:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1788592768.223627:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.223825:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871424 00000100:00100000:0.0:1788592768.223838:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871424 00000100:00100000:0.0:1788592768.223918:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:0.0:1788592768.223929:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+20:11622:x1875475136871424:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788592768.224063:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.224087:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.224099:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.224155:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.224172:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 20 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.224188:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147339008:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592768.224713:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf483180 going to sleep for 11 seconds 00000100:00100000:2.0:1788592768.235627:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592768.235884:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871552 00000100:00100000:1.0:1788592768.235897:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871552 00010000:00010000:1.0:1788592768.235950:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 21 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592768.236033:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1788592768.236043:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:2344:x1875475136871552:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788592768.236063:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592768.236072:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 21 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.236089:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 21 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.236119:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:1.0:1788592768.236137:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.236150:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.236159:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.236183:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592768.236255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:2344:x1875475136871552:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 213us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592768.236264:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00010000:00010000:0.0:1788592768.237485:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ee00/0x27b316f13251190b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d29 expref: 20 pid: 5822 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.237516:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5822:1875475147339008:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592768.237546:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237557:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237565:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237627:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237634:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237641:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237648:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592768.237653:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237661:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237677:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:0.0:1788592768.237680:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788592768.237685:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.237692:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511951 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.237767:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11622:x1875475136871424:12345-192.168.204.20@tcp:55:lhsmtool_posix.0 Request processed in 13838us (14156us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788592768.237776:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 229 00000100:00100000:3.0:1788592768.240521:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592768.240916:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871680 00000100:00100000:2.0:1788592768.240930:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871680 00000100:00100000:2.0:1788592768.241099:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:2.0:1788592768.241113:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2344:x1875475136871680:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788592768.241190:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.241217:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 8 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.241229:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592768.241234:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592768.241241:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.241289:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 8 pid: 8688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.241318:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 8 pid: 8688 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.241500:0:6678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875475147339136:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592768.241617:0:6678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981901c9480 going to sleep for 11 seconds 00000100:00100000:3.0:1788592768.245261:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592768.245296:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136871808 00000100:00100000:3.0:1788592768.245319:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136871808 00010000:00010000:3.0:1788592768.245394:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 9 pid: 8688 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592768.245441:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:3.0:1788592768.245453:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136871808:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592768.245492:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592768.245529:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 9 pid: 8688 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.245546:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 9 pid: 8688 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.245585:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592768.245591:0:11159:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592768.245599:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.245610:0:11159:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.245653:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592768.245717:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+9:2343:x1875475136871808:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 266us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592768.245737:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00010000:00010000:2.0:1788592768.246493:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092e1ea4e/0x27b316f132511935 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d45 expref: 8 pid: 8688 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.246514:0:6678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875475147339136:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592768.246542:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246555:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246563:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246594:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246604:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246613:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246653:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592768.246658:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246669:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246685:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.246693:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021eb7c3e/0x27b316f132511958 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.246781:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2344:x1875475136871680:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 5670us (6279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592768.246790:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 70 00000100:00100000:1.0:1788592768.250917:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592768.251071:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872064 00000100:00100000:2.0:1788592768.251085:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872064 00000100:00100000:2.0:1788592768.251209:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 230 00000100:00100000:2.0:1788592768.251224:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11622:x1875475136872064:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788592768.251432:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.251458:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.251498:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.252293:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.252490:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 20 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.252500:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.252549:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 20 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592768.252569:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 20 pid: 6700 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592768.252587:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147339264:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592768.254112:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981901c9480 going to sleep for 11 seconds 00010000:00010000:1.0:1788592768.259190:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592768.271609:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.272289:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872192 00000100:00100000:0.0:1788592768.272305:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872192 00010000:00010000:0.0:1788592768.272381:0:5809:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 21 pid: 6700 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.272441:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:0.0:1788592768.272453:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:2343:x1875475136872192:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592768.272474:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592768.272483:0:5809:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 21 pid: 6700 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.272499:0:5809:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 21 pid: 6700 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.272529:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:0.0:1788592768.272536:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.272548:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.272557:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.272596:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592768.272675:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+21:2343:x1875475136872192:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 224us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592768.272683:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00010000:00010000:3.0:1788592768.274144:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca600/0x27b316f132511919 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d30 expref: 20 pid: 6700 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592768.274174:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147339264:192.168.204.20@tcp:104: 00010000:00010000:3.0:1788592768.274211:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.274223:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.274249:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592768.274546:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788592768.275321:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788592768.275412:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788592768.275528:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875475147339392:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788592768.278093:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592768.278212:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187f07b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788592768.278274:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147339392 00000100:00100000:3.0:1788592768.278287:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147339392 00000100:00100000:2.0:1788592768.278844:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788592768.278858:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1875475147339392:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788592768.279020:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5823:x1875475147339392:12345-0@lo:1000:mdt00_001.0 Request processed in 165us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592768.279048:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592768.279137:0:5823:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788592768.279145:0:5823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788592768.279171:0:5823:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff898184e5b100, transno 4294967321 00000100:00100000:3.0:1788592768.279203:0:5823:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff898184e58a80 x1875475147338496/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788592784 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592768.279219:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875475147339392:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788592768.279914:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788592768.280027:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875475147339520:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788592768.280090:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592768.291015:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147339520 00000100:00100000:0.0:1788592768.291042:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147339520 00000100:00100000:0.0:1788592768.293212:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981905db000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592768.295241:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592768.295263:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5823:x1875475147339520:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788592768.296082:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5823:x1875475147339520:12345-0@lo:1000:mdt00_001.0 Request processed in 823us (15986us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788592768.296095:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592768.296192:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5823:1875475147339520:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788592768.296253:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296268:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296278:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296285:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.296291:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296310:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296331:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03ded00) 00010000:00010000:1.0:1788592768.296334:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592768.296340:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296505:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5a00/0x27b316f132511966 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296545:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296567:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296573:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296578:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.296581:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296587:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296596:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592768.296598:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592768.296605:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296618:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296628:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.296668:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592768.296684:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147339648:192.168.204.20@tcp:105: 00000100:00100000:1.0:1788592768.298413:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff898197709000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592768.314494:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7ced80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5823:1875475147339648:192.168.204.20@tcp:105: 00010000:00010000:1.0:1788592768.314551:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314566:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5e00/0x27b316f1325118a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314626:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314645:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314660:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314673:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314680:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314687:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314693:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988be400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.314697:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314705:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314755:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592768.314758:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592768.314763:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314770:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be400/0x27b316f13251196d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314782:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314788:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314795:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314811:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.314815:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314822:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314830:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592768.314832:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788592768.314835:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.314842:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5400/0x27b316f13251195f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592768.315866:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+23:11622:x1875475136872064:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 64576us (64893us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788592768.315882:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 230 00000020:00080000:1.0:1788592768.315891:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788592768.319608:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788592768.319623:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592768.320175:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788592768.320190:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592768.323209:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592768.324259:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872320 00000100:00100000:1.0:1788592768.324277:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872320 00000100:00100000:2.0:1788592768.325609:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592768.331415:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872576 00000100:00100000:3.0:1788592768.331437:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872576 00000100:00100000:3.0:1788592768.331512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 61 00000100:00100000:3.0:1788592768.331524:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+24:11622:x1875475136872576:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788592768.332497:0:5826:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788592768.332623:0:5826:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788592768.332689:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332720:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332735:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332746:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332753:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332761:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592768.332782:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788592768.332914:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11622:x1875475136872576:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 1388us (7313us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788592768.332925:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 61 00000020:00080000:3.0:1788592768.332932:0:5826:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788592768.332958:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 62 00000100:00100000:3.0:1788592768.332968:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11621:x1875475136872320:12345-192.168.204.20@tcp:49:lfs.0 00000100:00100000:3.0:1788592768.333050:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11621:x1875475136872320:12345-192.168.204.20@tcp:49:lfs.0 Request processed in 84us (9859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592768.333057:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 62 00010000:00010000:0.0:1788592768.334667:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592768.334697:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.334709:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592768.334714:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.334737:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.334759:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8981a03deb00) 00010000:00010000:0.0:1788592768.334762:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788592768.334769:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.334776:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c20e9c00/0x27b316f132511974 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5826 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.334815:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592768.334817:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592768.334819:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592768.348868:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592768.349061:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872832 00000100:00100000:2.0:1788592768.349075:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872832 00000100:00100000:2.0:1788592768.349157:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1788592768.349170:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11621:x1875475136872832:12345-192.168.204.20@tcp:58:lfs.0 00000040:00080000:2.0:1788592768.349568:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788592768.349670:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11621:x1875475136872832:12345-192.168.204.20@tcp:58:lfs.0 Request processed in 503us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592768.349679:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 231 00000100:00100000:2.0:1788592768.397042:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.397199:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136872960 00000100:00100000:0.0:1788592768.397215:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136872960 00000100:00100000:0.0:1788592768.397288:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 232 00000100:00100000:0.0:1788592768.397301:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+25:11624:x1875475136872960:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592768.397333:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592768.397390:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251197b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d4c expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397526:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397571:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397589:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397610:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397619:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.397627:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.398046:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.398061:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.398073:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.398136:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.398152:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 26 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.398184:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147339776:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592768.398999:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bf483180 going to sleep for 11 seconds 00000100:00100000:0.0:1788592768.406648:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5824:1875475147339776:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592768.406697:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592768.407019:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.407198:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136873216 00000100:00100000:0.0:1788592768.407208:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136873216 00000100:00100000:0.0:1788592768.407278:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:0.0:1788592768.407289:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+27:5583:x1875475136873216:12345-192.168.204.20@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788592768.408250:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:5583:x1875475136873216:12345-192.168.204.20@tcp:35:ldlm_bl.0 Request processed in 954us (1224us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788592768.408262:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 63 00000100:00100000:3.0:1788592768.417308:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592768.421515:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136873344 00000100:00100000:0.0:1788592768.421544:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136873344 00010000:00010000:0.0:1788592768.421632:0:11159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 28 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592768.421701:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:0.0:1788592768.421714:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+28:2344:x1875475136873344:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592768.421750:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592768.421762:0:11159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 28 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421812:0:11159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 28 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421852:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ea00/0x27b316f13251189b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d0d expref: 28 pid: 5824 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421884:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592768.421903:0:11159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421917:0:11159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421928:0:11159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592768.421973:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592768.422084:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182842d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+27:2344:x1875475136873344:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 372us (4800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592768.422093:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00010000:00010000:1.0:1788592768.422994:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423012:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592768.423100:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788592768.423107:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592768.423148:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423174:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423187:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423195:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423204:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423210:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.423235:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423249:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423266:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592768.423270:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592768.423275:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423283:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca000/0x27b316f132511982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423300:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423321:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423328:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423334:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592768.423338:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423345:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423402:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff898185c2dc00) 00010000:00010000:1.0:1788592768.423404:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592768.423415:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423422:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f132511989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423496:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251197b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d4c expref: 27 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423518:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d4c expref: 26 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592768.423528:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592768.423531:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592768.423534:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca200, rc 0) 00000100:00100000:1.0:1788592768.423612:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11624:x1875475136872960:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 26311us (26599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592768.423623:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 232 00010000:00010000:1.0:1788592769.278653:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788592769.345451:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592769.345465:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592769.345530:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788592769.345543:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592769.345707:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147339904:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788592769.345833:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981977090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592769.350446:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592769.350599:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136873472 00000100:00100000:2.0:1788592769.350614:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136873472 00000100:00100000:2.0:1788592769.350700:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00100000:2.0:1788592769.350712:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11635:x1875475136873472:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592769.350769:0:6700:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592769.350905:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+27:11635:x1875475136873472:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 194us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592769.350925:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 233 00000100:00080000:3.0:1788592769.351810:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592769.351949:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11675:1875475147339904:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592769.365499:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592769.366585:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136873728 00000100:00100000:0.0:1788592769.366602:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136873728 00000100:00100000:0.0:1788592769.366703:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:0.0:1788592769.366715:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+26:11635:x1875475136873728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592769.366745:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592769.366789:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511997 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d53 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.366946:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251199e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.366966:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251199e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.366981:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251199e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592769.366996:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788592769.367195:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb600/0x27b316f132511997 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d53 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.367217:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251199e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d53 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.367242:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592769.367246:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592769.367250:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592769.367338:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11635:x1875475136873728:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 625us (1853us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788592769.367345:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 234 00000100:00100000:3.0:1788592769.373438:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592769.373492:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592769.373501:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136873984 00000100:00100000:0.0:1788592769.373516:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136873984 00000100:00100000:0.0:1788592769.373589:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:0.0:1788592769.373601:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11635:x1875475136873984:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592769.373720:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.373745:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.373761:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374022:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374034:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374043:0:6700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374052:0:6700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccaa00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592769.374058:0:6700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374068:0:6700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374085:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592769.374088:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788592769.374095:0:6700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374122:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592769.374515:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11635:x1875475136873984:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 914us (1086us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788592769.374525:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 235 00000100:00100000:0.0:1788592769.374562:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136874112 00000100:00100000:0.0:1788592769.374567:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136874112 00000040:00080000:1.0:1788592769.374610:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592769.374618:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788592769.374623:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1788592769.374636:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+29:2344:x1875475136874112:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592769.374656:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592769.374677:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f13251199e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d53 expref: 29 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592769.374689:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592769.374694:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592769.374722:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+28:2344:x1875475136874112:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 89us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592769.374729:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000040:00080000:1.0:1788592769.375498:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788592769.375510:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592769.379133:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592769.379291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136874368 00000100:00100000:0.0:1788592769.379305:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136874368 00000100:00100000:0.0:1788592769.379449:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 64 00000100:00100000:0.0:1788592769.379463:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+28:11635:x1875475136874368:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592769.379817:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11635:x1875475136874368:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 355us (699us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788592769.379827:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 64 00000040:00080000:1.0:1788592769.753611:0:12551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788592769.753756:0:12551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788592769.753821:0:12551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788592769.753832:0:12551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788592769.790589:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147340032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592769.790699:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.790802:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340032 00000100:00100000:1.0:1788592769.790811:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340032 00000100:00100000:1.0:1788592769.790870:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592769.790881:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875475147340032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592769.790929:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592769.790984:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1875475147340032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.790992:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592769.791059:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147340032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592769.792037:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147340160:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792108:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.792145:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147340672:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792205:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.792234:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592769.792240:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147340288:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792263:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.792305:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340160 00000100:00100000:1.0:1788592769.792312:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340160 00000100:00100000:1.0:1788592769.792381:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788592769.792390:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147340160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792450:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147340160:12345-0@lo:400:kworker.0 Request processed in 61us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.792457:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788592769.792500:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340672 00000100:00100000:1.0:1788592769.792504:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340672 00000100:00100000:1.0:1788592769.792544:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340288 00000100:00100000:1.0:1788592769.792547:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340288 00000100:00100000:1.0:1788592769.792567:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788592769.792572:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147340672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792625:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875475147340672:12345-0@lo:400:kworker.0 Request processed in 53us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.792632:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788592769.792646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788592769.792651:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147340288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792677:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147340288:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.792683:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1788592769.792704:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592769.792723:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147340416:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792752:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.792772:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788592769.792779:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147340544:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792808:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.792835:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340416 00000100:00100000:1.0:1788592769.792839:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340416 00000100:00100000:1.0:1788592769.792867:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788592769.792872:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147340416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792913:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147340416:12345-0@lo:400:kworker.0 Request processed in 41us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592769.792920:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1788592769.792936:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592769.792963:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147340416:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.792994:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147340288:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.793003:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147340160:0@lo:400:kworker.0 00000100:00100000:1.0:1788592769.793010:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3283:1875475147340672:0@lo:400:kworker.0 00000100:00100000:0.0:1788592769.795405:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340544 00000100:00100000:0.0:1788592769.795428:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340544 00000100:00100000:0.0:1788592769.795542:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788592769.795553:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875475147340544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592769.797165:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3285:x1875475147340544:12345-0@lo:400:kworker.0 Request processed in 1602us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592769.797182:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788592769.797795:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147340800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592769.797858:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592769.797956:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147340544:0@lo:400:kworker.0 00000100:00100000:3.0:1788592769.799154:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340800 00000100:00100000:3.0:1788592769.799166:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340800 00000100:00100000:3.0:1788592769.799306:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788592769.799319:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147340800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592769.799438:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592769.799531:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147340800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592769.799540:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788592769.799608:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898085891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147340800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592770.016148:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592770.016278:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136874624 00000100:00100000:0.0:1788592770.016293:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136874624 00000100:00100000:0.0:1788592770.016415:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:0.0:1788592770.016428:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+29:11648:x1875475136874624:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592770.016464:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592770.016498:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325119b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d5a expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592770.016713:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592770.016733:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592770.016751:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6700 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592770.016766:0:6700:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788592770.017150:0:6700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f1325119b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d5a expref: 32 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592770.017171:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d5a expref: 31 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592770.017195:0:6700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592770.017199:0:6700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788592770.017203:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccaa00, rc 0) 00000100:00100000:0.0:1788592770.017291:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11648:x1875475136874624:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 866us (1156us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788592770.017299:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 236 00000100:00100000:3.0:1788592770.023496:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592770.023623:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136874752 00000100:00100000:1.0:1788592770.023635:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136874752 00000100:00100000:1.0:1788592770.023738:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:1.0:1788592770.023752:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11648:x1875475136874752:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592770.023866:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023889:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023905:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023937:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023961:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023970:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023978:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592770.023984:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.023994:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.024012:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592770.024016:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592770.024023:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592770.024031:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f1325119c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592770.024148:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+31:11648:x1875475136874752:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 398us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592770.024156:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 237 00000100:00100000:3.0:1788592770.167915:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592770.168444:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136874880 00000100:00100000:0.0:1788592770.168459:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136874880 00000100:00100000:2.0:1788592770.168701:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:2.0:1788592770.168726:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136874880:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1788592770.168753:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592770.168781:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f1325119cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d61 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592770.168816:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9bc27d, atime: 0x6a9bc27d, ctime: 0x6a9bc27d, blocks: 0xb 00010000:00010000:2.0:1788592770.168843:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788592770.168849:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592770.168860:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f1325119cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d61 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592770.168885:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f1325119cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d61 expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592770.168901:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592770.168975:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb362a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136874880:12345-192.168.204.20@tcp:101:cat.0 Request processed in 254us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592770.168983:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00080000:1.0:1788592770.169574:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592770.188986:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592770.189030:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875008 00000100:00100000:0.0:1788592770.189043:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875008 00002000:00100000:0.0:1788592770.189117:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff898085891880 x1875475136875008/t0(0) o3->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:46/0 lens 488/0 e 0 to 0 dl 1788592781 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592770.189128:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898085891880 with x1875475136875008 ext(0->4095) 00002000:00010000:0.0:1788592770.189137:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898085891880 00000100:00100000:0.0:1788592770.189175:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1788592770.189185:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2342:x1875475136875008:12345-192.168.204.20@tcp:3:cat.0 00000100:00100000:0.0:1788592770.189474:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2342:x1875475136875008:12345-192.168.204.20@tcp:3:cat.0 Request processed in 289us (504us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788592770.189482:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00002000:00100000:0.0:1788592770.189489:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff898085891880 x1875475136875008/t0(0) o3->551ef727-4fdd-447b-98b8-d223b2dddab7@192.168.204.20@tcp:46/0 lens 488/4536 e 0 to 0 dl 1788592781 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788592770.189497:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff898085891880 with x1875475136875008 ext(0->4095) 00002000:00010000:0.0:1788592770.189500:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff898085891880 00010000:00010000:0.0:1788592770.305015:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592770.960346:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1788592770.960411:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1788592771.072129:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592771.072270:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592771.072414:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592771.072470:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592771.072508:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592771.072772:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875648 00000100:00100000:2.0:1788592771.072792:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875648 00000100:00100000:2.0:1788592771.072883:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875264 00000100:00100000:2.0:1788592771.072888:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875264 00000100:00100000:2.0:1788592771.072917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:2.0:1788592771.072931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136875648:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592771.073057:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2341:x1875475136875648:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 128us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592771.073076:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 169 00000100:00100000:2.0:1788592771.073103:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00100000:2.0:1788592771.073110:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:2341:x1875475136875264:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592771.073140:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+31:2341:x1875475136875264:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592771.073146:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 170 00000100:00080000:2.0:1788592771.073165:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592771.076504:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875136 00000100:00100000:1.0:1788592771.076526:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875136 00000100:00100000:1.0:1788592771.076955:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 304 00000100:00100000:1.0:1788592771.076972:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136875136:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592771.077110:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136875136:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 142us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592771.083503:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875392 00000100:00100000:0.0:1788592771.083526:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875392 00000100:00100000:0.0:1788592771.083612:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875520 00000100:00100000:0.0:1788592771.083616:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875520 00000100:00100000:3.0:1788592771.083737:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1788592771.083754:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136875392:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592771.083939:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc1e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+8:2341:x1875475136875392:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 189us (11667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592771.083948:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 71 00000100:00100000:3.0:1788592771.083972:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1788592771.083994:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136875520:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592771.084027:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2341:x1875475136875520:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 34us (11518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592771.084033:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00080000:2.0:1788592771.085400:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592771.100393:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 304 00010000:00010000:1.0:1788592771.327996:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592772.351571:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592773.380479:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788592773.485722:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788592773.485760:0:5844:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788592773.485774:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1788592773.485783:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000020:00080000:2.0:1788592773.485800:0:5844:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff898190089b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788592773.485805:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981884caa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff898190089240 00000020:00080000:2.0:1788592773.485809:0:5844:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8981884ca700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff898184f2c000 00000020:00080000:1.0:1788592773.485823:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788592773.486071:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788592774.399077:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592774.910654:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788592774.910747:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592774.910847:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341184 00000100:00100000:1.0:1788592774.910855:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341184 00000100:00100000:1.0:1788592774.910918:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788592774.910928:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147341184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592774.910979:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147341184:12345-0@lo:400:kworker.0 Request processed in 53us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592774.910986:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1788592774.911028:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592774.911062:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147341184:0@lo:400:kworker.0 00000100:00100000:1.0:1788592774.911101:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592774.911107:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147341312:0@lo:400:kworker.0 00000100:00100000:1.0:1788592774.911134:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592774.911390:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147341056:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911420:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592774.911437:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147341568:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911457:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592774.911475:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788592774.911479:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147340928:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911505:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592774.911526:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911545:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592774.911570:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341312 00000100:00100000:0.0:1788592774.911573:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341312 00000100:00100000:0.0:1788592774.911618:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341568 00000100:00100000:0.0:1788592774.911621:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341568 00000100:00100000:0.0:1788592774.911644:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788592774.911651:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147341312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911684:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147341312:12345-0@lo:400:kworker.0 Request processed in 33us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.911690:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788592774.911703:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788592774.911708:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147341568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911746:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981c21d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147341568:12345-0@lo:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.911769:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788592774.911789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147340928 00000100:00100000:0.0:1788592774.911793:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147340928 00000100:00100000:0.0:1788592774.911816:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788592774.911823:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147340928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911853:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147340928:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.911858:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788592774.911886:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341056 00000100:00100000:0.0:1788592774.911889:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341056 00000100:00100000:0.0:1788592774.911911:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341440 00000100:00100000:0.0:1788592774.911913:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341440 00000100:00100000:0.0:1788592774.911934:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788592774.911940:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898085892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147341056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.911969:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898085892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147341056:12345-0@lo:400:kworker.0 Request processed in 29us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.911974:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788592774.911985:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788592774.911991:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147341440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.912029:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147341440:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.912035:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1788592774.912050:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592774.912054:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592774.912056:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592774.912084:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147340928:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.912107:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147341440:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.912115:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147341056:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.912121:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788592774.912127:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788592774.912148:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8981bd15dc00, transno 4294967310 00000100:00100000:0.0:1788592774.912158:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147341568:0@lo:400:kworker.0 00000100:00100000:0.0:1788592774.912477:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788592774.912481:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff898184e58a80, transno 4294967322 00000004:00080000:0.0:1788592774.912490:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788592774.912500:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147341312:0@lo:400:kworker.0 00000100:00100000:3.0:1788592774.913114:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592774.913126:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147341696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592774.913167:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592774.913893:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592774.913905:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147341824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592774.913938:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592774.916305:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341696 00000100:00100000:2.0:1788592774.916318:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341696 00000100:00100000:0.0:1788592774.916423:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341824 00000100:00100000:0.0:1788592774.916428:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341824 00000100:00100000:0.0:1788592774.916493:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788592774.916503:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147341824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592774.916566:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592774.916647:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147341824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592774.916654:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788592774.916842:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147341824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592774.917038:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788592774.917046:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147341696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592774.917068:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592774.917156:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147341696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (3988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592774.917163:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788592774.917253:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147341696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788592775.428066:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592776.165838:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592776.165884:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592776.165911:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592776.165944:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592776.165985:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592776.166014:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876288 00000100:00100000:3.0:1788592776.166024:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876288 00000100:00100000:3.0:1788592776.166076:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875904 00000100:00100000:3.0:1788592776.166078:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875904 00000100:00100000:3.0:1788592776.166098:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1788592776.166123:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136876288:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592776.166452:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2342:x1875475136876288:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 331us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592776.166459:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 174 00000100:00100000:3.0:1788592776.166476:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:3.0:1788592776.166482:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2342:x1875475136875904:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592776.166503:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2342:x1875475136875904:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 21us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592776.166509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 175 00000100:00100000:3.0:1788592776.166524:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876032 00000100:00100000:3.0:1788592776.166528:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876032 00000100:00100000:3.0:1788592776.166553:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876160 00000100:00100000:3.0:1788592776.166556:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876160 00000100:00100000:3.0:1788592776.166577:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1788592776.166584:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2342:x1875475136876032:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592776.166605:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2342:x1875475136876032:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 23us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592776.166611:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 75 00000100:00100000:3.0:1788592776.166620:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:3.0:1788592776.166626:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136876160:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592776.166642:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb47f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136876160:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 17us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592776.166648:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00080000:0.0:1788592776.167611:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788592776.167617:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592776.167621:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592776.167757:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136875776 00000100:00100000:1.0:1788592776.167765:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136875776 00000100:00100000:1.0:1788592776.167812:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 306 00000100:00100000:1.0:1788592776.167821:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136875776:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592776.167897:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818844b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2342:x1875475136875776:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 77us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592776.167904:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 306 00000100:00100000:3.0:1788592776.185478:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592776.188127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876416 00000100:00100000:0.0:1788592776.188461:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876416 00000100:00100000:0.0:1788592776.188560:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:0.0:1788592776.188837:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11300:x1875475136876416:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788592776.189782:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11300:x1875475136876416:12345-192.168.204.20@tcp:60:lhsmtool_posix.0 Request processed in 1207us (4310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592776.189792:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 238 00000100:00100000:2.0:1788592776.192695:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592776.192884:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876672 00000100:00100000:0.0:1788592776.192895:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876672 00000100:00100000:0.0:1788592776.193093:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 65 00000100:00100000:0.0:1788592776.193105:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:11300:x1875475136876672:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788592776.193687:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:11300:x1875475136876672:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 583us (1000us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788592776.193696:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 65 00010000:00010000:3.0:1788592776.446532:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592776.690330:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592776.690550:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876800 00000100:00100000:1.0:1788592776.690572:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876800 00000100:00100000:1.0:1788592776.690661:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 239 00000100:00100000:1.0:1788592776.690675:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+5:12101:x1875475136876800:12345-192.168.204.20@tcp:101:lsof.0 00010000:00010000:1.0:1788592776.690703:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592776.690955:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325119d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d68 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691246:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691266:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691281:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592776.691325:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592776.691328:0:5824:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592776.691381:0:5824:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691499:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be800/0x27b316f1325119d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d68 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691521:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d68 expref: 6 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592776.691531:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:1.0:1788592776.691534:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592776.691539:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfa00, rc 0) 00000100:00100000:1.0:1788592776.691920:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+6:12101:x1875475136876800:12345-192.168.204.20@tcp:101:lsof.0 Request processed in 1247us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592776.691929:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 239 00010000:00010000:0.0:1788592777.470896:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592777.598638:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592777.598657:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592777.599016:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788592777.599024:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788592778.495424:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788592778.645135:0:12717:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788592778.645204:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788592778.645220:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788592778.651433:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:0.0:1788592779.522742:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592780.030952:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147341952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592780.031047:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592780.031270:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147341952 00000100:00100000:0.0:1788592780.031280:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147341952 00000100:00100000:0.0:1788592780.031453:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788592780.031465:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147341952:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788592780.031962:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592780.033091:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147342464:0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.033170:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592780.034761:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147342080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592780.034848:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592780.035089:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147342208:0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.035128:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592780.035156:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147342720:0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.035182:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592780.035206:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592780.035212:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147342336:0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.035241:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592780.035279:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342464 00000100:00100000:2.0:1788592780.035288:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342464 00000100:00100000:2.0:1788592780.035387:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342336 00000100:00100000:2.0:1788592780.035390:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342336 00000100:00100000:2.0:1788592780.035416:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592780.035427:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147342464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592780.035609:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147342592:0@lo:400:kworker.0 00000100:00100000:1.0:1788592780.035637:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592780.035664:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342592 00000100:00100000:1.0:1788592780.035668:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342592 00000100:00100000:1.0:1788592780.035692:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788592780.035698:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147342336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592780.035734:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147342336:12345-0@lo:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.035741:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788592780.035837:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788592780.036028:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147342592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592780.036069:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147342592:12345-0@lo:400:kworker.0 Request processed in 211us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.036075:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788592780.036103:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342080 00000100:00100000:1.0:1788592780.036108:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342080 00000100:00100000:1.0:1788592780.036137:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592780.036145:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147342080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592780.036183:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592780.036220:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147342080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.036226:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592780.036283:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147342080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592780.036296:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147342592:0@lo:400:kworker.0 00000100:00100000:1.0:1788592780.036331:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147342336:0@lo:400:kworker.0 00002000:00000024:1.0:1788592780.036380:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592780.036418:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147341952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4955us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592780.036424:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788592780.038603:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147342464:12345-0@lo:400:kworker.0 Request processed in 69us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592780.038635:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788592780.038695:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342208 00000100:00100000:2.0:1788592780.038706:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342208 00000100:00100000:2.0:1788592780.038990:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788592780.039000:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147342208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.039105:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147342208:12345-0@lo:400:kworker.0 Request processed in 107us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592780.039112:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788592780.039198:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147342208:0@lo:400:kworker.0 00000100:00100000:3.0:1788592780.045477:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342720 00000100:00100000:3.0:1788592780.045499:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342720 00000100:00100000:3.0:1788592780.045573:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788592780.045585:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147342720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592780.045714:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147342720:12345-0@lo:400:kworker.0 Request processed in 131us (10531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592780.045723:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788592780.045786:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147342720:0@lo:400:kworker.0 00000100:00080000:3.0:1788592780.045821:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592780.045828:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592780.047563:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147342464:0@lo:400:kworker.0 00000100:00100000:2.0:1788592780.047596:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb24ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147341952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788592780.546594:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592780.954927:0:12755:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:19:38 (1788592778) 00000100:00100000:3.0:1788592781.285267:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592781.285315:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592781.285342:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592781.285389:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592781.285448:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592781.285495:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877056 00000100:00100000:3.0:1788592781.285509:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877056 00000100:00100000:3.0:1788592781.285574:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877440 00000100:00100000:3.0:1788592781.285577:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877440 00000100:00100000:3.0:1788592781.285603:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:3.0:1788592781.285615:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2342:x1875475136877056:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592781.286336:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:551ef727-4fdd-447b-98b8-d223b2dddab7+18:2342:x1875475136877056:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 718us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592781.290031:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 179 00000100:00100000:3.0:1788592781.290078:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1788592781.290094:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2341:x1875475136877440:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592781.290191:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2341:x1875475136877440:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 103us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592781.290198:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 180 00000100:00100000:3.0:1788592781.290226:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136876928 00000100:00100000:3.0:1788592781.290235:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136876928 00000100:00100000:3.0:1788592781.290279:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 308 00000100:00100000:3.0:1788592781.290286:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136876928:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592781.290316:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2341:x1875475136876928:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 31us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592781.290323:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 308 00000100:00100000:3.0:1788592781.290380:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877312 00000100:00100000:3.0:1788592781.290385:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877312 00000100:00100000:3.0:1788592781.290419:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877184 00000100:00100000:3.0:1788592781.290422:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877184 00000100:00100000:3.0:1788592781.290442:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1788592781.290448:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136877312:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592781.290488:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2342:x1875475136877312:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 39us (5144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592781.290495:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1788592781.290505:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:3.0:1788592781.290511:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136877184:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592781.290556:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2341:x1875475136877184:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 45us (5167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592781.290564:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00080000:3.0:1788592781.290590:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592781.290595:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592781.290598:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788592781.567163:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592782.592155:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592783.616801:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592784.640434:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592785.150958:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592785.150990:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147342848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592785.151092:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592785.151188:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342848 00000100:00100000:2.0:1788592785.151198:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342848 00000100:00100000:2.0:1788592785.152504:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788592785.152528:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147342848:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788592785.152555:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788592785.152582:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592785.152683:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147342848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592785.152690:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788592785.152839:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147342848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592785.153795:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147343360:0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.153866:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592785.153921:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592785.153927:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147343232:0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.153980:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592785.154014:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343360 00000100:00100000:1.0:1788592785.154022:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343360 00000100:00100000:1.0:1788592785.154081:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592785.154090:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147343360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.154132:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147343360:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592785.154139:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788592785.154170:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343232 00000100:00100000:1.0:1788592785.154173:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343232 00000100:00100000:1.0:1788592785.154199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788592785.154205:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147343232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.154232:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147343232:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592785.154237:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1788592785.154256:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592785.154260:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592785.156099:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147343232:0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.156119:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147343360:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.156579:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147342976:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.156663:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592785.156724:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147343488:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.156752:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592785.156775:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592785.156781:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147343104:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.156816:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592785.156961:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147342976 00000100:00100000:1.0:1788592785.156969:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147342976 00000100:00100000:1.0:1788592785.157029:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788592785.157039:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147342976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592785.157098:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3285:x1875475147342976:12345-0@lo:400:kworker.0 Request processed in 60us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592785.157104:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788592785.157449:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343488 00000100:00100000:3.0:1788592785.157454:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343488 00000100:00100000:3.0:1788592785.157504:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343104 00000100:00100000:3.0:1788592785.157507:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343104 00000100:00100000:3.0:1788592785.157523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788592785.157529:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147343488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592785.157579:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147343488:12345-0@lo:400:kworker.0 Request processed in 50us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.157586:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788592785.157597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788592785.157602:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147343104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592785.157624:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147343104:12345-0@lo:400:kworker.0 Request processed in 22us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.157629:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:1.0:1788592785.157736:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592785.158457:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147343104:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.158470:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147342976:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.158479:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147343488:0@lo:400:kworker.0 00000100:00100000:2.0:1788592785.159854:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788592785.160423:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147343616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592785.160510:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592785.160678:0:11473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343616 00000100:00100000:1.0:1788592785.160689:0:11473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343616 00000100:00100000:1.0:1788592785.160795:0:11473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788592785.160819:0:11473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147343616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592785.160867:0:11473:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592785.160933:0:11473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147343616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592785.160940:0:11473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788592785.161030:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bb249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147343616:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788592785.662662:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592785.860460:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592785.861102:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877696 00000100:00100000:0.0:1788592785.861118:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877696 00000100:00100000:0.0:1788592785.861223:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00100000:0.0:1788592785.861237:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+18:12322:x1875475136877696:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1788592785.861801:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:12322:x1875475136877696:12345-192.168.204.20@tcp:35:umount.0 Request processed in 564us (1355us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788592785.861811:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 66 00000100:00080000:1.0:1788592785.862661:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592785.872111:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592785.872569:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136877952 00000100:00100000:0.0:1788592785.872584:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136877952 00000100:00100000:0.0:1788592785.872676:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:0.0:1788592785.872689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+19:12322:x1875475136877952:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1788592785.873195:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+20:12322:x1875475136877952:12345-192.168.204.20@tcp:35:umount.0 Request processed in 507us (1097us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788592785.873204:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 67 00000100:00100000:2.0:1788592785.879597:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592785.879986:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878208 00000100:00100000:0.0:1788592785.880001:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878208 00000100:00100000:0.0:1788592785.880079:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:0.0:1788592785.880092:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818735d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+20:12322:x1875475136878208:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1788592785.881081:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818735d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+21:12322:x1875475136878208:12345-192.168.204.20@tcp:35:umount.0 Request processed in 985us (1493us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788592785.881093:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 68 00000100:00100000:1.0:1788592785.885099:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592785.885189:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878464 00000100:00100000:0.0:1788592785.885202:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878464 00000100:00100000:0.0:1788592785.885300:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:0.0:1788592785.885312:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+21:12322:x1875475136878464:12345-192.168.204.20@tcp:35:umount.0 00000100:00100000:0.0:1788592785.885917:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+22:12322:x1875475136878464:12345-192.168.204.20@tcp:35:umount.0 Request processed in 604us (831us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788592785.885926:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 69 00000100:00100000:2.0:1788592785.896881:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592785.896923:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592785.896965:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592785.897006:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592785.897132:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878720 00000100:00100000:3.0:1788592785.897145:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878720 00000100:00100000:3.0:1788592785.897229:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878592 00000100:00100000:3.0:1788592785.897233:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878592 00000100:00100000:3.0:1788592785.897269:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878848 00000100:00100000:3.0:1788592785.897283:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878848 00000100:00100000:3.0:1788592785.897304:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1788592785.897314:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+15:2344:x1875475136878720:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592785.897337:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592785.897404:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4c00/0x27b316f1325109bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18bb expref: 15 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592785.897427:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592785.897493:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+14:2344:x1875475136878720:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 180us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.897502:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:3.0:1788592785.897521:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592785.897528:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+13:2344:x1875475136878592:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592785.897537:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592785.897547:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c21c5e00/0x27b316f132510a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18f3 expref: 13 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592785.897557:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592785.897576:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2344:x1875475136878592:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 48us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.897583:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592785.897596:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592785.897603:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+11:2344:x1875475136878848:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592785.897611:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592785.898060:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4800/0x27b316f132510c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19be expref: 11 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592785.898083:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592785.898104:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136878848:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 501us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592785.898111:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592785.898138:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136878976 00000100:00100000:3.0:1788592785.898142:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136878976 00000100:00100000:3.0:1788592785.898184:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:3.0:1788592785.898191:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+5:2340:x1875475136878976:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:3.0:1788592785.898220:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510d2d 00000100:00080000:3.0:1788592785.898228:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8981bc84c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592785.898605:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788592785.898918:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592785.898926:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788592785.902200:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+2:2340:x1875475136878976:12345-192.168.204.20@tcp:9:umount.0 Request processed in 3992us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592785.902228:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 72 00000100:00100000:2.0:1788592785.911820:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592785.911970:0:8688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136879360 00000100:00100000:1.0:1788592785.911986:0:8688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136879360 00000100:00100000:1.0:1788592785.912070:0:8688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:1.0:1788592785.912083:0:8688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+7:2340:x1875475136879360:12345-192.168.204.20@tcp:9:umount.0 00000020:00000080:1.0:1788592785.912127:0:8688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510f8e 00000020:00010000:1.0:1788592785.912135:0:8688:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8981bbb8f800: total 0 00000100:00080000:1.0:1788592785.912141:0:8688:0:(import.c:65:import_set_state_nolock()) ffff8981bbb8e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788592785.912195:0:8688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1788592785.912376:0:5811:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8981bbb8f800: total 0 00000100:00080000:2.0:1788592785.912484:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788592785.912579:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8981bbb8f800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788592785.912728:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bc94dd5/0x27b316f1325119cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d61 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592785.912769:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013366918/0x27b316f132511331 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b93 expref: 5 pid: 8688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592785.912796:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8981bbb8f800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788592785.912810:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592785.912812:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592785.912814:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592785.915988:0:8688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:551ef727-4fdd-447b-98b8-d223b2dddab7+2:2340:x1875475136879360:12345-192.168.204.20@tcp:9:umount.0 Request processed in 3889us (4163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592785.916008:0:8688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 73 00000100:00100000:0.0:1788592785.925919:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592785.926062:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136880384 00000100:00100000:3.0:1788592785.926076:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136880384 00000100:00100000:3.0:1788592785.926151:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 240 00000100:00100000:3.0:1788592785.926163:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+22:2340:x1875475136880384:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1788592785.926206:0:5822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325109c9 00000020:00010000:3.0:1788592785.926236:0:5822:0:(genops.c:1921:obd_stale_export_put()) Put export ffff898184fce800: total 0 00000100:00080000:3.0:1788592785.926241:0:5822:0:(import.c:65:import_set_state_nolock()) ffff898084ac9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592785.926274:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788592785.926765:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb249500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:551ef727-4fdd-447b-98b8-d223b2dddab7+21:2340:x1875475136880384:12345-192.168.204.20@tcp:39:umount.0 Request processed in 602us (863us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788592785.926775:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 240 00000020:00010000:1.0:1788592785.927026:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff898184fce800: total 0 00010000:00010000:1.0:1788592785.927032:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592785.927085:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff898184fce800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788592785.927130:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592785.927149:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592785.927161:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca200/0x27b316f132511990 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d4c expref: 20 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927185:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:1.0:1788592785.927188:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592785.927193:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be200/0x27b316f132511393 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1baf expref: 19 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927209:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981898bf800) 00010000:00010000:1.0:1788592785.927212:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592785.927216:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5c00/0x27b316f132510caf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19d3 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927237:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592785.927240:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592785.927244:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f5800/0x27b316f1325112f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b7e expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927257:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592785.927260:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592785.927263:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4600/0x27b316f13251131c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b8c expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927276:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592785.927278:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788592785.927282:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccaa00/0x27b316f1325119ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d5a expref: 15 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927309:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff898185c2db00) 00010000:00010000:1.0:1788592785.927311:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592785.927316:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb800/0x27b316f132510c93 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19cc expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927333:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592785.927336:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788592785.927338:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4a00/0x27b316f1325113af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1bb6 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927381:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8981898bf700) 00010000:00010000:1.0:1788592785.927384:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592785.927387:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bec00/0x27b316f13251168e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1c88 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927402:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8981a1fe1400) 00010000:00010000:1.0:1788592785.927404:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592785.927408:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c5600/0x27b316f132511212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1b46 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927424:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592785.927426:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788592785.927429:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981885f4400/0x27b316f132510d03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19e8 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927440:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592785.927442:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592785.927452:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f1325118b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d14 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927468:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8981a1fe1a00) 00010000:00010000:1.0:1788592785.927470:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788592785.927474:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981c21c4000/0x27b316f132510ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1aba expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592785.927486:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff898184fce800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788592785.927498:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592785.927500:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592785.927502:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592786.232581:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:0.0:1788592786.232591:0:7632:0:(genops.c:885:class_export_put()) final put ffff8981bc84d000/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:1.0:1788592786.232670:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bc84d000/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-OST0001 00000020:00000080:1.0:1788592786.232731:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981bc84c800 for lustre-OST0001 00000100:00100000:2.0:1788592786.408531:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592786.408592:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592786.408672:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136880512 00000100:00100000:3.0:1788592786.408674:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136880640 00000100:00100000:3.0:1788592786.408687:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136880640 00000100:00100000:1.0:1788592786.408687:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136880512 00000100:00100000:3.0:1788592786.408754:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:3.0:1788592786.408769:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2344:x1875475136880640:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592786.408835:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 310 00000100:00100000:1.0:1788592786.408846:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136880512:12345-192.168.204.20@tcp:400:kworker.0 00000100:00080000:2.0:1788592786.408917:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592786.408965:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2344:x1875475136880640:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592786.408973:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 184 00000100:00100000:1.0:1788592786.412469:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2344:x1875475136880512:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 3609us (3937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592786.412488:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 310 00010000:00010000:0.0:1788592786.686764:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592787.710635:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592787.807789:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592787.807841:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592787.807887:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592787.813304:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136880768 00000100:00100000:2.0:1788592787.813329:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136880768 00000100:00100000:3.0:1788592787.813891:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136880896 00000100:00100000:3.0:1788592787.813899:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136880896 00000100:00100000:3.0:1788592787.813924:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881024 00000100:00100000:3.0:1788592787.813928:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881024 00000100:00100000:2.0:1788592787.813942:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1788592787.813960:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2344:x1875475136880768:12345-192.168.204.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788592787.813962:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1788592787.813978:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+12:2343:x1875475136880896:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592787.813988:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592787.813989:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592787.814024:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccb000/0x27b316f132510aa2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1932 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592787.814024:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bccca400/0x27b316f132510a9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1908 expref: 12 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592787.814057:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788592787.814057:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592787.814143:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+10:2343:x1875475136880896:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 168us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592787.814151:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1788592787.814178:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1788592787.814189:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+9:2343:x1875475136881024:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592787.814197:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592787.814207:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762f800/0x27b316f132510c62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d19b7 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592787.814218:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592787.817460:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a743afaf-efea-4d20-b19b-8e962ea96cca+8:2344:x1875475136880768:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 3486us (9667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592787.817481:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:3.0:1788592787.824225:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a743afaf-efea-4d20-b19b-8e962ea96cca+7:2343:x1875475136881024:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 10020us (16318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592787.824245:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:3.0:1788592787.824377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592787.824512:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881280 00000100:00100000:3.0:1788592787.824526:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881280 00000100:00100000:3.0:1788592787.824592:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 241 00000100:00100000:3.0:1788592787.824604:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+6:2340:x1875475136881280:12345-192.168.204.20@tcp:39:umount.0 00000020:00000080:3.0:1788592787.824701:0:5822:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510ab0 00000020:00010000:3.0:1788592787.824712:0:5822:0:(genops.c:1921:obd_stale_export_put()) Put export ffff898084346800: total 0 00000100:00080000:3.0:1788592787.824717:0:5822:0:(import.c:65:import_set_state_nolock()) ffff898084345000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788592787.824744:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788592787.825014:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4db69f-98e2-4e24-80ee-276a360c1356+5:2340:x1875475136881280:12345-192.168.204.20@tcp:39:umount.0 Request processed in 412us (637us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788592787.825022:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 241 00000020:00010000:0.0:1788592787.827192:0:5811:0:(genops.c:1907:obd_stale_export_get()) Get export ffff898084346800: total 0 00010000:00010000:0.0:1788592787.827277:0:5811:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff898084346800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788592787.827327:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289ab00) 00010000:00010000:0.0:1788592787.827333:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592787.827387:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfa00/0x27b316f1325119dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d68 expref: 4 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592787.827419:0:5811:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff898084346800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788592787.827452:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592787.827455:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592787.827457:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592787.839814:0:11675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788592787.839829:0:11675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788592787.840295:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788592787.840305:0:11675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788592787.862192:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592787.866429:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881536 00000100:00100000:2.0:1788592787.866456:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881536 00000100:00100000:2.0:1788592787.866553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 311 00000100:00100000:2.0:1788592787.866565:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+7:2340:x1875475136881536:12345-192.168.204.20@tcp:251:umount.0 00000020:00000080:2.0:1788592787.866639:0:5818:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325109a6 00000020:00010000:2.0:1788592787.866649:0:5818:0:(genops.c:1921:obd_stale_export_put()) Put export ffff898084bc5000: total 0 00000100:00080000:2.0:1788592787.866654:0:5818:0:(import.c:65:import_set_state_nolock()) ffff898084bc7800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788592787.866912:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a743afaf-efea-4d20-b19b-8e962ea96cca+3:2340:x1875475136881536:12345-192.168.204.20@tcp:251:umount.0 Request processed in 206us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592787.866924:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 311 00000020:00010000:3.0:1788592787.867556:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff898084bc5000: total 0 00010000:00010000:3.0:1788592787.867562:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592787.867621:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff898084bc5000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788592787.867663:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4600/0x27b316f132510a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d18fa expref: 2 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592787.867679:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff898084bc5000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788592787.867686:0:5812:0:(genops.c:885:class_export_put()) final put ffff898084bc5000/a743afaf-efea-4d20-b19b-8e962ea96cca 00010000:00010000:3.0:1788592787.867706:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592787.867708:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592787.867710:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788592787.867919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc5000/a743afaf-efea-4d20-b19b-8e962ea96cca for MGS 00000020:00000080:0.0:1788592787.867966:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084bc7800 for MGS 00010000:00010000:1.0:1788592788.734883:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788592788.832520:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1788592788.832639:0:12717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e4db69f-98e2-4e24-80ee-276a360c1356 00000001:00080000:1.0:1788592788.832650:0:12717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788592788.832654:0:12717:0:(genops.c:885:class_export_put()) final put ffff898084346800/3e4db69f-98e2-4e24-80ee-276a360c1356 00000001:00100000:1.0:1788592788.832672:0:12717:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000001:00080000:1.0:1788592788.832679:0:12717:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788592788.832864:0:5844:0:(genops.c:885:class_export_put()) final put ffff898184fce800/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:0.0:1788592788.832884:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff898084346800/3e4db69f-98e2-4e24-80ee-276a360c1356 for lustre-MDT0000 00000020:00000080:0.0:1788592788.832969:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fce800/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-MDT0000 00000020:00000080:0.0:1788592788.833017:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084345000 for lustre-MDT0000 00000020:00000080:0.0:1788592788.833023:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084ac9000 for lustre-MDT0000 00000001:00100000:1.0:1788592788.853970:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:1.0:1788592788.853981:0:6703:0:(genops.c:885:class_export_put()) final put ffff8981bbb8f800/551ef727-4fdd-447b-98b8-d223b2dddab7 00000020:00000080:2.0:1788592788.854262:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bbb8f800/551ef727-4fdd-447b-98b8-d223b2dddab7 for lustre-OST0000 00000020:00000080:2.0:1788592788.854577:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981bbb8e000 for lustre-OST0000 00010000:00010000:1.0:1788592789.758897:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788592790.024026:0:12956:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788592790.034609:0:12956:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788592790.034901:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.034921:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.034930:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.034938:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.035569:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592790.035580:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788592790.035627:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592790.035636:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788592790.035647:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788592790.035715:0:12956:0:(import.c:65:import_set_state_nolock()) ffff898184fea800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788592790.037827:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147343744:0@lo:39:umount.0 00000100:00100000:2.0:1788592790.037925:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592790.038018:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343744 00000100:00100000:2.0:1788592790.038028:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343744 00000100:00100000:2.0:1788592790.038087:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788592790.038096:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875475147343744:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788592790.038130:0:5824:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325107b5 00000100:00080000:2.0:1788592790.038140:0:5824:0:(import.c:65:import_set_state_nolock()) ffff898197207000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788592790.038270:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592790.038291:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038303:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f600 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592790.038308:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038321:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592790.038330:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592790.038337:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592790.038340:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788592790.038345:0:5811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788592790.038407:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038429:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592790.038457:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038466:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762f600/0x27b316f132510a2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a32 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038484:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592790.038486:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592790.038489:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592790.038507:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147343872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.038549:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592790.038615:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147343872 00000100:00100000:3.0:1788592790.038620:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147343872 00000100:00100000:3.0:1788592790.038668:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788592790.038678:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3283:x1875475147343872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592790.038691:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592790.038723:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762e000/0x27b316f132510a32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a2b expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.038873:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592790.038932:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3283:x1875475147343872:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.038946:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788592790.039019:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3282:x1875475147343744:12345-0@lo:39:umount.0 Request processed in 923us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592790.039027:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788592790.039036:0:5824:0:(genops.c:885:class_export_put()) final put ffff898197202000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788592790.039065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898197202000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788592790.039120:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898197207000 for lustre-MDT0000 00000100:00080000:2.0:1788592790.039166:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898184fea800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788592790.039179:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147343744:0@lo:39:umount.0 00000100:00100000:3.0:1788592790.039481:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147343872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592790.039791:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592790.039880:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592790.039884:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788592790.039889:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788592790.043925:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.043976:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.043984:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.043991:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044012:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592790.044019:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044026:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044031:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044037:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044052:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788592790.044070:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592790.044077:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044084:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592790.044094:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044104:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592790.044113:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592790.044119:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592790.044121:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788592790.044172:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044178:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592790.044203:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044211:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762ec00/0x27b316f132510a39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a40 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044229:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592790.044233:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044239:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e8000 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592790.044243:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044250:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592790.044267:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592790.044273:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592790.044275:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788592790.044277:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788592790.044293:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044299:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592790.044322:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044329:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e8000/0x27b316f132510960 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510967 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044346:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044379:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044381:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044396:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044404:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044409:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044414:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044436:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592790.044443:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592790.044447:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044452:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4a00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592790.044455:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044462:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592790.044470:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592790.044475:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788592790.044477:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788592790.044478:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788592790.044492:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044498:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592790.044504:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044511:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981885f4a00/0x27b316f132510c54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c5b expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044519:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044525:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044527:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044537:0:12956:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044544:0:12956:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044550:0:12956:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044556:0:12956:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044567:0:12956:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592790.044571:0:12956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788592790.044574:0:12956:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788592790.044622:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592790.044626:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044633:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592790.044635:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044641:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592790.044647:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592790.044680:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788592790.044682:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788592790.044684:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788592790.044700:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044718:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592790.044724:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044731:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762f200/0x27b316f132510714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f13251071b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592790.044743:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044745:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.044746:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788592790.044762:0:12956:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788592790.044766:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788592790.044771:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592790.044778:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788592790.044788:0:12956:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8981bbb8a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592790.044795:0:12956:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff89819840a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592790.044800:0:12956:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff898184e70000) has exports, disconnecting them 00000100:00100000:3.0:1788592790.046197:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147344256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.046297:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592790.046365:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147344128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592790.046398:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592790.046606:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344256 00000100:00100000:3.0:1788592790.046616:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344256 00000020:00080000:1.0:1788592790.046770:0:12956:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8981bbb8a000), last request at 1788592785 00000020:00000080:1.0:1788592790.046785:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510928 00000100:00100000:3.0:1788592790.046876:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344128 00000100:00100000:3.0:1788592790.046880:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344128 00000100:00100000:3.0:1788592790.046909:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592790.046919:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+19:3286:x1875475147344256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592790.046934:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592790.046955:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bccca800/0x27b316f132510c5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510c54 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.046972:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592790.047020:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+18:3286:x1875475147344256:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.047047:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592790.047068:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592790.047074:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+17:3285:x1875475147344128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592790.047083:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592790.047093:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762f400/0x27b316f132510967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510960 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.047107:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592790.047137:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb24ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3285:x1875475147344128:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.047144:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592790.047189:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147344128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.047226:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147344000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.047255:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592790.047283:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592790.047290:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147344384:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788592790.047397:0:12956:0:(import.c:65:import_set_state_nolock()) ffff8981bbb89800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788592790.047447:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788592790.047463:0:12956:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8981bbb8a000): rc 0 00000020:00000080:1.0:1788592790.047466:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bbb8a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788592790.047488:0:12956:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89819840a000), last request at 1788592785 00000020:00000080:1.0:1788592790.047493:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251085d 00000100:00080000:1.0:1788592790.047500:0:12956:0:(import.c:65:import_set_state_nolock()) ffff8981904a1800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788592790.047512:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788592790.047520:0:12956:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89819840a000): rc 0 00000020:00000080:1.0:1788592790.047522:0:12956:0:(genops.c:885:class_export_put()) final put ffff89819840a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788592790.047531:0:12956:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffafe2038c3ae0 00000100:00080000:1.0:1788592790.047552:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788592790.047556:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:2.0:1788592790.047613:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344000 00000100:00100000:2.0:1788592790.047620:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344000 00000100:00100000:2.0:1788592790.047744:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788592790.047754:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+16:3284:x1875475147344000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592790.047763:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592790.047774:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dfa00/0x27b316f132510a40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a39 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.047789:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592790.047903:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:3284:x1875475147344000:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592790.047911:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:2.0:1788592790.047933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bbb8a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788592790.047985:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89819840a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788592790.048015:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981bbb89800 for lustre-MDT0000 00000020:00000080:2.0:1788592790.048021:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981904a1800 for lustre-MDT0000 00000100:00100000:3.0:1788592790.048437:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592790.048496:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147344000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.048550:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3766d60d-7279-4c7a-a56f-5f796f49fe93:3286:1875475147344256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592790.048579:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344384 00000100:00100000:3.0:1788592790.048583:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344384 00000100:00100000:3.0:1788592790.048621:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592790.048628:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3766d60d-7279-4c7a-a56f-5f796f49fe93+15:3284:x1875475147344384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592790.048640:0:11159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1788592790.048787:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788592790.048934:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788592790.048958:0:12956:0:(import.c:65:import_set_state_nolock()) ffff8981c0d88800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788592790.048979:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788592790.048984:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788592790.048996:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788592790.049059:0:12956:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788592790.049068:0:12956:0:(import.c:65:import_set_state_nolock()) ffff898184fcf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788592790.049104:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff898184e70000) has no exports 00000100:00100000:2.0:1788592790.049470:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147344512:0@lo:9:umount.0 00000100:00100000:2.0:1788592790.049531:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592790.049564:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147344640:0@lo:9:umount.0 00000100:00100000:2.0:1788592790.049587:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788592790.051775:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813df600/0x27b316f13251071b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510714 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592790.051817:0:11159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592790.051931:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3766d60d-7279-4c7a-a56f-5f796f49fe93+14:3284:x1875475147344384:12345-0@lo:103:ldlm_bl.0 Request processed in 3300us (3493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592790.051944:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788592790.052139:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3766d60d-7279-4c7a-a56f-5f796f49fe93:3284:1875475147344384:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592790.052188:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592790.053945:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344512 00000100:00100000:1.0:1788592790.053963:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344512 00000100:00100000:1.0:1788592790.054090:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344640 00000100:00100000:1.0:1788592790.054095:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344640 00000100:00100000:0.0:1788592790.054235:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788592790.054260:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875475147344512:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788592790.054300:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325108aa 00000100:00080000:0.0:1788592790.054310:0:6677:0:(import.c:65:import_set_state_nolock()) ffff898184fce000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788592790.054363:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788592790.054852:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3282:x1875475147344512:12345-0@lo:9:umount.0 Request processed in 593us (5318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592790.054861:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788592790.054880:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8981c0d88800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788592790.054894:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788592790.054897:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788592790.054901:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147344512:0@lo:9:umount.0 00000100:00080000:3.0:1788592790.055765:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592790.055774:0:5819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592790.056065:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788592790.056080:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875475147344640:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788592790.056116:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510991 00000100:00080000:1.0:1788592790.056127:0:6678:0:(import.c:65:import_set_state_nolock()) ffff898184fcb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788592790.056168:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788592790.056615:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3282:x1875475147344640:12345-0@lo:9:umount.0 Request processed in 540us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592790.056644:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788592790.056686:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592790.056693:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788592790.057006:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898184fcf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788592790.057031:0:3282:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788592790.057033:0:3282:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788592790.057045:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147344640:0@lo:9:umount.0 00000020:00080000:3.0:1788592790.061638:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff898184e70000) has no exports 00000020:00000080:3.0:1788592790.130749:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251076f 00000020:00000080:3.0:1788592790.130772:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981b3803000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788592790.130790:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788592790.130886:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981b3803000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788592790.130913:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592790.130924:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788592790.130929:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8981bf3e8000) has no exports 00000020:00000080:2.0:1788592790.131947:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510768 00000020:00000080:2.0:1788592790.131955:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bf3a7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592790.132022:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592790.132033:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788592790.132037:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bf3a5800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788592790.132039:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bf3a5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788592790.132045:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788592790.132812:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bf3a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788592790.133390:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff898193b02360 - data ffff89819ff096c0/ffff898198873000 00000020:01000000:2.0:1788592790.133578:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8981abfa3ba0 - data ffff89819fd81510/ffff8981bb22e400 00000001:00000004:1.0:1788592790.166588:0:12956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788592790.253549:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788592790.253578:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788592790.253595:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788592790.253598:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788592790.254738:0:6838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788592790.254747:0:6838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788592790.254759:0:6838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788592790.259627:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788592790.259640:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788592790.259783:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788592790.259786:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788592790.263692:0:8057:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788592790.263714:0:8057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788592790.263731:0:8057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000100:00100000:1.0:1788592790.270506:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147344768:0@lo:400:kworker.0 00000100:00100000:1.0:1788592790.270601:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592790.270689:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147344896:0@lo:400:kworker.0 00000100:00100000:1.0:1788592790.270729:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592790.270779:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344768 00000100:00100000:1.0:1788592790.270789:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344768 00000100:00100000:1.0:1788592790.270829:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147344896 00000100:00100000:1.0:1788592790.270832:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147344896 00000100:00100000:1.0:1788592790.270853:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788592790.270861:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875475147344768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788592790.270870:0:5822:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788592790.270918:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1875475147344768:12345-0@lo:400:kworker.0 Request processed in 55us (316us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592790.270925:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788592790.270956:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788592790.270961:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875475147344896:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788592790.270966:0:5822:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788592790.270991:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1875475147344896:12345-0@lo:400:kworker.0 Request processed in 29us (261us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788592790.270997:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788592790.271051:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788592790.271056:0:3285:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788592790.271060:0:3285:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788592790.275712:0:3284:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788592790.275722:0:3284:0:(import.c:65:import_set_state_nolock()) ffff898084aca000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788592790.275729:0:3284:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788592790.275736:0:3284:0:(import.c:65:import_set_state_nolock()) ffff898084aca000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592790.275741:0:3284:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 140 00000100:00080000:0.0:1788592790.275754:0:3284:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff898084aca000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592790.275818:0:3284:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bd15e680 x1875475147345024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592790.275853:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147344768:0@lo:400:kworker.0 00000100:00100000:2.0:1788592790.276399:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147345024:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788592790.276496:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592790.276987:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345024 00000100:00100000:0.0:1788592790.277009:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345024 00000100:00100000:0.0:1788592790.277267:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788592790.277278:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147345024:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788592790.277303:0:5822:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788592790.279852:0:3285:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592790.279865:0:3285:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 160 00000100:00080000:1.0:1788592790.279879:0:3285:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff898084bc7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592790.279929:0:3285:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087921f80 x1875475147345152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592790.279970:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147344896:0@lo:400:kworker.0 00000100:00100000:2.0:1788592790.281274:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147345152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788592790.281559:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592790.283452:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345152 00000100:00100000:3.0:1788592790.283543:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345152 00000100:00100000:3.0:1788592790.283603:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788592790.283613:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875475147345152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788592790.283637:0:5823:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788592790.285443:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3282:x1875475147345152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1185us (3357us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592790.285462:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788592790.296633:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592790.296647:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592790.296865:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147345152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788592790.301936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147345024:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 24646us (25427us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788592790.301954:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788592790.302025:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084aca000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592790.302031:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788592790.302035:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147345024:0@lo:38:ptlrpcd_00_01.0 00000020:00000080:0.0:1788592790.384678:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510737 00000020:00000080:0.0:1788592790.384694:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788592790.384961:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788592790.391374:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251074c 00000020:00000080:2.0:1788592790.391395:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788592790.391429:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788592790.391435:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592790.391446:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788592790.391451:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff898184e74d40) has no exports 00000020:00000080:3.0:1788592790.391591:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788592790.391845:0:12956:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788592790.391854:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251098a 00000020:00000080:2.0:1788592790.391859:0:12956:0:(genops.c:885:class_export_put()) final put ffff898084bc6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788592790.391873:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788592790.391877:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592790.392007:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788592790.392059:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788592790.392121:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff898198498000) has no exports 00000020:00000080:2.0:1788592790.392129:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510983 00000020:00000080:2.0:1788592790.392134:0:12956:0:(genops.c:885:class_export_put()) final put ffff898184fcc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788592790.392295:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fcc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788592790.394173:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788592790.394183:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788592790.394189:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788592790.394200:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788592790.394202:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788592790.394605:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898184fcf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788592790.394672:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592790.394686:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592790.394693:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981c0d89800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788592790.394696:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981c0d89800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788592790.394713:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592790.394807:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325108a3 00000020:00000080:2.0:1788592790.394814:0:12956:0:(genops.c:885:class_export_put()) final put ffff898084816800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788592790.394829:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788592790.394834:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788592790.394840:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788592790.394844:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8981884a99c0) has no exports 00000020:00000080:2.0:1788592790.394851:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251089c 00000020:00000080:2.0:1788592790.394854:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981c0d8f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788592790.394966:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898084816800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788592790.394984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981c0d8f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788592790.397764:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788592790.397775:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788592790.397780:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788592790.397790:0:12956:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788592790.397793:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788592790.397861:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592790.397873:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788592790.397927:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981c0d88800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788592790.397940:0:36:0:(genops.c:885:class_export_put()) final put ffff898184fcd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788592790.397957:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fcd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788592790.397964:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788592790.399684:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592790.399708:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788592790.399715:0:12956:0:(genops.c:885:class_export_put()) final put ffff898197201000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788592790.399719:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff898197201000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788592790.399726:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788592790.399901:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510753 00000020:00000080:3.0:1788592790.399910:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31c000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788592790.399922:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788592790.399927:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592790.399933:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788592790.399938:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff898184e719c0) has no exports 00000020:00000080:0.0:1788592790.399950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788592790.399963:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592790.399967:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788592790.399969:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31e000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788592790.399972:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31e000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788592790.399976:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788592790.401680:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251075a 00000020:00000080:3.0:1788592790.401709:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788592790.401781:0:12956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff898190067800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788592790.401786:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898190067800 3 00000020:01000004:3.0:1788592790.401790:0:12956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff898190067800 from lustre-MDT0000 00000020:00000080:3.0:1788592790.401827:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592790.401837:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788592790.401852:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981bd31d000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788592790.401854:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788592790.401866:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788592790.401913:0:12956:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788592790.401917:0:12956:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788592790.401922:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788592790.401926:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592790.401929:0:12956:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788592790.401936:0:12956:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8981884b5000 3766d60d-7279-4c7a-a56f-5f796f49fe93 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788592790.401942:0:12956:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff89818738b380) has exports, disconnecting them 00000020:00080000:3.0:1788592790.401948:0:12956:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8981884b5000), last request at 1788592548 00000020:00000080:3.0:1788592790.401964:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325106f8 00000020:00010000:3.0:1788592790.401968:0:12956:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8981884b5000: total 1 00000100:00080000:3.0:1788592790.401973:0:12956:0:(import.c:65:import_set_state_nolock()) ffff8981884b7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788592790.401994:0:12956:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8981884b5000): rc 0 00000020:00080000:3.0:1788592790.401998:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff89818738b380) has no exports 00000020:00010000:2.0:1788592790.402057:0:5812:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8981884b5000: total 1 00010000:00010000:2.0:1788592790.402101:0:5812:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8981884b5000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788592790.402137:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813df200/0x27b316f132510a24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a1d expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402161:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89819762fc00/0x27b316f132510a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a47 expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402174:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981988bfe00/0x27b316f132510c4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510c46 expref: 7 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402184:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f5600/0x27b316f132510c3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510c38 expref: 6 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402199:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e9600/0x27b316f132510810 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510809 expref: 5 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402213:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4e00/0x27b316f132510a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a01 expref: 4 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402223:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813dee00/0x27b316f132510a16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f132510a0f expref: 3 pid: 5817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402239:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981813de200/0x27b316f1325109fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x27b316f1325109f3 expref: 2 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592790.402250:0:5812:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8981884b5000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788592790.402263:0:5812:0:(genops.c:885:class_export_put()) final put ffff8981884b5000/3766d60d-7279-4c7a-a56f-5f796f49fe93 00000100:00100000:3.0:1788592790.402312:0:5817:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8981897b3c00:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1788592790.402317:0:5815:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff898190469000:5815] 0 exiting: rc = 1 00000100:00100000:3.0:1788592790.403586:0:5818:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff898184e16400:5818] 2 exiting: rc = 0 00000100:00100000:3.0:1788592790.403705:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403718:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403728:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403734:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403741:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403748:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403758:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403765:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403773:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403780:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403785:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403794:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403801:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403807:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403834:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403841:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403850:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403857:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403865:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.403872:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404027:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404035:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404042:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404052:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404058:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404144:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404151:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404157:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404300:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404308:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404317:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404323:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404330:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404339:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404378:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404385:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404391:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404397:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404403:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404409:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404414:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404420:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404426:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.404432:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405410:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405418:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405423:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405430:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405438:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405477:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405484:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405821:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405828:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405835:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405840:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405845:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405851:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405857:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405863:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405869:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405875:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405963:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405973:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.405979:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788592790.407406:0:12956:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788592790.407413:0:12956:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1788592790.407768:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bd31e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788592790.409414:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592790.409423:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592790.409427:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788592790.409590:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981884b5000/3766d60d-7279-4c7a-a56f-5f796f49fe93 for MGS 00000020:00000080:0.0:1788592790.409652:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8981884b7800 for MGS 00000020:01000000:3.0:1788592790.410539:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8981bf4e9300 - data ffff8980847f8360/ffff8981bcd9a800 00000020:01000000:3.0:1788592790.410692:0:12956:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff898182bd6780 - data ffff89819ff23af8/ffff898183f28400 00000020:00000080:3.0:1788592790.411679:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325106dc 00000020:00000080:3.0:1788592790.411689:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981884b6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788592790.411710:0:12956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff898190067800 from MGS, refs=2 00000020:01000004:3.0:1788592790.411714:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898190067800 2 00000020:01000004:3.0:1788592790.411718:0:12956:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff898190067800 from MGS 00000020:00000080:3.0:1788592790.411744:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592790.411752:0:12956:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788592790.411753:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981884b6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788592790.411756:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981884b0000/MGS 00000020:00000080:3.0:1788592790.411758:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981884b0000/MGS for MGS 00000020:01000000:3.0:1788592790.411765:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788592790.411835:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788592790.411841:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592790.411847:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788592790.411860:0:12956:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89819725a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788592790.411867:0:12956:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8981bf3e99c0) has exports, disconnecting them 00000020:00080000:3.0:1788592790.411877:0:12956:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89819725a800), last request at 1788592549 00000020:00000080:3.0:1788592790.411957:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325107a7 00000020:00080000:3.0:1788592790.411967:0:12956:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff89819725a800): rc 0 00000020:00000080:3.0:1788592790.411972:0:12956:0:(genops.c:885:class_export_put()) final put ffff89819725a800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788592790.415425:0:12956:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788592790.415437:0:12956:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592790.415442:0:12956:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788592790.415452:0:12956:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788592790.416294:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff89819725a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788592790.419249:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898184fea800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788592790.419453:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592790.419465:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788592790.419471:0:12956:0:(genops.c:885:class_export_put()) final put ffff898184fef000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788592790.419476:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fef000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788592790.419482:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788592790.419977:0:12956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898190067800 1 00000020:00000080:0.0:1788592790.419985:0:12956:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325106ce 00000020:00000080:0.0:1788592790.419994:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981884b7000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788592790.420010:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788592790.420016:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592790.420022:0:12956:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788592790.420026:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8981884ab380) has no exports 00000020:00000080:2.0:1788592790.420144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981884b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788592790.461114:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592790.461137:0:12956:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788592790.461145:0:12956:0:(genops.c:885:class_export_put()) final put ffff898190065000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788592790.461151:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff898190065000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788592790.461168:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788592790.462326:0:12956:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff898190061000 00000020:01000000:0.0:1788592790.462366:0:12956:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788592790.462372:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592790.462390:0:12956:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788592790.462395:0:12956:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff898184e73380) has no exports 00000100:00100000:2.0:1788592790.462714:0:6700:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff898084136a00:6700] 3 exiting: rc = 0 00000100:00100000:0.0:1788592790.464589:0:5822:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89819885d800:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1788592790.464715:0:5824:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff898184e2b000:5824] 2 exiting: rc = 0 00000100:00100000:3.0:1788592790.464945:0:5823:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff898184e2a000:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1788592790.465109:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465120:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465127:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465134:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465141:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465146:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465153:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465159:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465166:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465177:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465183:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465189:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465194:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465200:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465206:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465213:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465220:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465225:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465231:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465237:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465243:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465248:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465254:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465259:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465264:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465269:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465275:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465280:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465286:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465321:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465326:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465332:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465339:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465345:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465380:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465387:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465394:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465400:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465406:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465412:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465418:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465424:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465430:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465436:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465442:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465448:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465470:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465477:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465483:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465489:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465494:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465501:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465508:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465514:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465520:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465527:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465533:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465539:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465546:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465553:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465561:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465567:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465574:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.465581:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.481799:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff898184e2aa00:5825] 0 exiting: rc = 1 00000100:00100000:1.0:1788592790.481947:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff898184e2ae00:5826] 1 exiting: rc = 0 00000100:00100000:2.0:1788592790.482299:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482317:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482324:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482774:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482786:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482795:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482803:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482813:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482820:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482828:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482835:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482843:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482852:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482858:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482864:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482871:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482877:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482882:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482888:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482893:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482900:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482905:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482911:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482917:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482923:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482929:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482936:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482942:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482948:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482954:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482960:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482966:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482972:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482979:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.482985:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483008:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483016:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483023:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483030:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483036:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483042:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483048:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483055:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483075:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483082:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483088:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483096:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483102:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483108:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483115:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483122:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483128:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483133:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483139:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483145:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483152:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483158:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483173:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483180:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483186:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483192:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483197:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483202:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.483209:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.485734:0:5827:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff898184856600:5827] 0 exiting: rc = 1 00000100:00100000:1.0:1788592790.485942:0:12001:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8981bf4a2c00:12001] 2 exiting: rc = 0 00000100:00100000:2.0:1788592790.486912:0:5828:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89819885c000:5828] 1 exiting: rc = 0 00000100:00100000:3.0:1788592790.487190:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487201:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487210:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487219:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487226:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487242:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487249:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487257:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487291:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487310:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487317:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487324:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487339:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487375:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487384:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487391:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487399:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487405:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487412:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487418:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487440:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487448:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487455:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487463:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487483:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487492:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487514:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487521:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487529:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487537:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487544:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487551:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487590:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487600:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487608:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487616:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487623:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487631:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487638:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487645:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487653:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487660:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487667:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487675:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487709:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487723:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487730:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487748:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487756:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487763:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487770:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487777:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487784:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487790:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487798:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487807:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487828:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487837:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487845:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487852:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487859:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487874:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487881:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592790.487887:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.510079:0:5829:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff898184e2a400:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1788592790.510758:0:5830:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8981885fbc00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788592790.510978:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.510989:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.510995:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.510999:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511005:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511012:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511017:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511027:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511032:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511037:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511042:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511048:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511054:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511077:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511082:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511087:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511093:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511098:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511104:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511109:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511115:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511122:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511232:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511239:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511244:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511251:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511256:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511262:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511268:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511272:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511277:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511282:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511287:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511292:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511296:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511303:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511308:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511313:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511318:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511323:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511329:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511334:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511340:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511345:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511376:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511384:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511389:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511396:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511412:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511420:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511430:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511438:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511445:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511454:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511464:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511471:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511476:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511481:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511490:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511500:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511507:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511517:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511526:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.511536:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788592790.512425:0:5831:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8981971e9e00:5831] 0 exiting: rc = 1 00000100:00100000:1.0:1788592790.512519:0:5832:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89819885ca00:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1788592790.512599:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512607:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512613:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512619:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512624:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512630:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512636:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512642:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512647:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512654:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512660:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512666:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512672:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512678:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512687:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512693:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512709:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512714:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512720:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512726:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512732:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512746:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512752:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512758:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512764:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512769:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512776:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512781:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512798:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512803:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512809:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512815:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512820:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512826:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512832:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512838:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512845:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512850:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512856:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512862:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512868:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512874:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512880:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512885:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512889:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512895:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512900:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512905:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512910:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512915:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512921:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512927:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512933:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512938:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512944:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512950:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512956:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512961:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512967:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512972:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512979:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512985:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.512990:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513003:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513393:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8981971ea400:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1788592790.513776:0:5833:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8981971e9000:5833] 0 exiting: rc = 1 00000100:00100000:0.0:1788592790.513859:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513867:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513873:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513879:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513884:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513889:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513895:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513899:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513904:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513909:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513914:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513920:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513926:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513931:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513937:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513942:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513947:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513952:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513957:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513962:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513968:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513973:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513978:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513983:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513989:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.513995:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514000:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514006:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514013:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514018:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514025:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514031:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514038:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514065:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514072:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514078:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514084:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514090:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514096:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514102:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514108:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514114:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514121:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514127:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514132:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514138:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514144:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514150:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514157:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514162:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514168:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514174:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514180:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514186:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514192:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514198:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514204:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514210:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514216:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514222:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514235:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514241:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514247:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592790.514253:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.515427:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8981971e9c00:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788592790.516400:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8981971e9600:5836] 1 exiting: rc = 0 00000100:00100000:0.0:1788592790.516859:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8981971e9a00:5837] 2 exiting: rc = 0 00000100:00100000:1.0:1788592790.517247:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517257:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517263:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517269:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517276:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517300:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517308:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517315:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517320:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517327:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517333:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517338:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517344:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517405:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517414:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517422:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517450:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517457:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517466:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517473:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517480:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517487:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517494:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517500:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517505:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517511:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517518:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517525:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517531:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517555:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517563:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517570:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517578:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517585:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517591:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517598:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517605:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517613:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517619:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517625:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517631:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517637:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517644:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517651:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517659:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517666:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517673:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517679:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517771:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.517779:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518071:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518087:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518095:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518117:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518189:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518198:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518205:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518211:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518217:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518225:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518232:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518239:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518246:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592790.518252:0:12956:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788592790.531640:0:12956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592790.531660:0:12956:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788592790.532430:0:12956:0:(genops.c:885:class_export_put()) final put ffff8981b3804000/MDS_uuid 00000020:00000080:0.0:1788592790.532437:0:12956:0:(genops.c:844:class_export_destroy()) destroying export ffff8981b3804000/MDS_uuid for MDS 00000020:01000000:0.0:1788592790.532451:0:12956:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788592790.532627:0:12956:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788592790.784137:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788592791.332963:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788592791.332976:0:7632:0:(genops.c:885:class_export_put()) final put ffff898184fcb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788592791.333048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fcb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788592791.333107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898184fcb000 for lustre-OST0001 00010000:00010000:2.0:1788592791.808949:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592792.830640:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788592793.790938:0:13105:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788592793.807005:0:13105:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788592793.807066:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.807081:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.807089:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.807096:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.807118:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788592793.807123:0:13105:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788592793.807149:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592793.807170:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788592793.807179:0:13105:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788592793.807187:0:13105:0:(import.c:65:import_set_state_nolock()) ffff898084aca000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788592793.807196:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592793.807198:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788592793.807201:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788592793.808370:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592793.808384:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.808411:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:2.0:1788592793.808416:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.808431:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788592793.808438:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592793.808445:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788592793.808448:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788592793.808452:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788592793.808499:0:5812:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.808506:0:5812:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788592793.808553:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.808561:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762e200/0x27b316f132510a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a16 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592793.808582:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592793.808584:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592793.808586:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592793.808663:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788592793.808687:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147345280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592793.808765:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592793.809055:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345280 00000100:00100000:2.0:1788592793.809064:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345280 00000100:00100000:2.0:1788592793.809119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788592793.809129:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3285:x1875475147345280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788592793.809142:0:5808:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592793 with bad export cookie 2860655413497497336 00010000:00010000:1.0:1788592793.809568:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809578:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809584:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809591:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809663:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592793.809670:0:13105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809677:0:13105:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809684:0:13105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592793.809689:0:13105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814163:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592793.814182:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814198:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981813dfc00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592793.814204:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814216:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592793.814225:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592793.814231:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788592793.814234:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788592793.814284:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814290:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592793.814321:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814366:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981813dfc00/0x27b316f132510a1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510a24 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814392:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592793.814397:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814403:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccac00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592793.814406:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814413:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592793.814419:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592793.814425:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788592793.814427:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788592793.814439:0:5811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814445:0:5811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788592793.814450:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592793.814457:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592793.814459:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592793.814461:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592793.814493:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147345408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592793.814565:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592793.814619:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592793.814624:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147345536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592793.814657:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592793.814689:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345408 00000100:00100000:0.0:1788592793.814697:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345408 00000100:00100000:0.0:1788592793.814732:0:11159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345536 00000100:00100000:0.0:1788592793.814734:0:11159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345536 00000100:00100000:0.0:1788592793.814745:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592793.814753:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875475147345408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788592793.814759:0:11159:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592793 with bad export cookie 2860655413497497336 00000100:00100000:0.0:1788592793.814795:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875475147345408:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (230us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788592793.814802:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788592793.814819:0:11159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592793.814822:0:11159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981880e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875475147345536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788592793.814827:0:11159:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788592793 with bad export cookie 2860655413497497336 00000100:00100000:0.0:1788592793.814858:0:11159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981880e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3283:x1875475147345536:12345-0@lo:103:ldlm_bl.0 Request processed in 22us (188us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788592793.814865:0:11159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788592793.814899:0:3283:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788592793.814904:0:3283:0:(import.c:65:import_set_state_nolock()) ffff898184e3d800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788592793.814908:0:3283:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788592793.821275:0:13105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788592793.821292:0:13105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bcccac00/0x27b316f132510c46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x27b316f132510c4d expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592793.821318:0:13105:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788592793.821327:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3285:x1875475147345280:12345-0@lo:103:ldlm_bl.0 Request processed in 12190us (12553us total) trans 0 rc -107/-107 10000000:01000000:1.0:1788592793.821331:0:13105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788592793.821338:0:13105:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00100000:2.0:1788592793.821388:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:01000004:1.0:1788592793.821404:0:13105:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788592793.821410:0:13105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788592793.821439:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592793.821448:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788592793.821457:0:13105:0:(genops.c:1819:print_export_data()) lustre-OST0000: UNLINKED ffff898184fc9000 lustre-MDT0000-mdtlov_UUID 0@lo 1 (0 1 0) 1 0 0 0: 0000000000000000 4294967324 stale:0 00000020:00080000:1.0:1788592793.821464:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8981bf3eb380) has no exports 00000020:00080000:1.0:1788592793.821493:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8981bf3eb380) has no exports 00000100:00080000:1.0:1788592793.823489:0:3285:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788592793.823611:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788592793.846599:0:3283:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.120@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788592793.846606:0:3283:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788592793.846617:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bc5d1c00 x1875475147345280/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592793.847506:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bd15f480 x1875475147345408/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592793.847519:0:3283:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bd15c700 x1875475147345536/t0(0) o103->MGC192.168.204.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788592809 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788592793.848728:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788592793.848736:0:3283:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788592793.848737:0:3283:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788592793.848787:0:3285:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff898184e3d800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788592793.848813:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3766d60d-7279-4c7a-a56f-5f796f49fe93:3285:1875475147345280:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788592793.849034:0:3283:0:(import.c:65:import_set_state_nolock()) ffff898184e3d800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592793.849041:0:3283:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 122 00000100:00080000:0.0:1788592793.849051:0:3283:0:(import.c:665:import_select_connection()) MGC192.168.204.120@tcp: import ffff898184e3d800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592793.849105:0:3283:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bd15dc00 x1875475147345664/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592793.849164:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3766d60d-7279-4c7a-a56f-5f796f49fe93:3282:1875475147345664:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788592793.849224:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875475147345664 offset 0 length 520: 4 00000100:00100000:0.0:1788592793.849537:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147345408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592793.849554:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3766d60d-7279-4c7a-a56f-5f796f49fe93:3283:1875475147345536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592793.855046:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788592793.910579:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788592793.910597:0:6703:0:(genops.c:885:class_export_put()) final put ffff898184fc9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788592793.910790:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898184fc9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788592793.910861:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898184fce000 for lustre-OST0000 00010000:00010000:3.0:1788592794.879870:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592795.390881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3766d60d-7279-4c7a-a56f-5f796f49fe93->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592795.390897:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3766d60d-7279-4c7a-a56f-5f796f49fe93->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592795.390900:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788592795.390904:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788592795.390910:0:36:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592795.390921:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 364 00000100:00080000:3.0:1788592795.390928:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592795.390939:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff898084bc7000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592795.391004:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc786300 x1875475147345792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592795.392468:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147345792:0@lo:38:kworker.0 00000400:00000100:1.0:1788592795.392716:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875475147345792 offset 0 length 520: 4 00000020:01000000:1.0:1788592795.838622:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8981bf4e90c0 - data ffff8980847f8948/ffff8981bcd99400 00000020:01000000:1.0:1788592795.838861:0:13105:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8981bcda1540 - data ffff898084518ca8/ffff8980841d8800 00100000:10000000:1.0:1788592795.850524:0:13105:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788592795.876404:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f13251082c 00000020:00000080:1.0:1788592795.876420:0:13105:0:(genops.c:885:class_export_put()) final put ffff898084816000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788592795.876441:0:13105:0:(tgt_mount.c:187:server_put_mount()) put mount ffff898188438800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788592795.876445:0:13105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898188438800 2 00000020:01000004:1.0:1788592795.876449:0:13105:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff898188438800 from lustre-OST0000 00000020:00000080:1.0:1788592795.876479:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592795.876491:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788592795.876494:0:13105:0:(genops.c:885:class_export_put()) final put ffff898084811800/lustre-OST0000_UUID 00000020:00000080:1.0:1788592795.876497:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff898084811800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788592795.876505:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788592795.876557:0:13105:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788592795.876563:0:13105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788592795.876567:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592795.876572:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788592795.876580:0:13105:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff898084acd800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788592795.876587:0:13105:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff89818738cd40) has exports, disconnecting them 00000020:00080000:1.0:1788592795.876603:0:13105:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff898084acd800), last request at 1788592566 00000020:00000080:1.0:1788592795.876609:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510856 00000020:00080000:1.0:1788592795.876622:0:13105:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff898084acd800): rc 0 00000020:00000080:1.0:1788592795.876628:0:13105:0:(genops.c:885:class_export_put()) final put ffff898084acd800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788592795.876880:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898084816000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788592795.879269:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff898084acd800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788592795.880251:0:13105:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788592795.880258:0:13105:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788592795.880264:0:13105:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788592795.880271:0:13105:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788592795.880918:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084aca000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788592795.881213:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592795.881225:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788592795.881232:0:13105:0:(genops.c:885:class_export_put()) final put ffff898084ac8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788592795.881237:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff898084ac8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788592795.881263:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788592795.881344:0:13105:0:(obd_mount.c:710:lustre_put_lsi()) put ffff898188438800 1 00000020:00000080:1.0:1788592795.881484:0:13105:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325107e6 00000020:00000080:1.0:1788592795.881493:0:13105:0:(genops.c:885:class_export_put()) final put ffff8981904a5800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788592795.881543:0:13105:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788592795.881549:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592795.881554:0:13105:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592795.881558:0:13105:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff89819849cd40) has no exports 00000020:00000080:2.0:1788592795.886950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8981904a5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788592795.904835:0:13105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788592795.905516:0:13105:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788592795.905524:0:13105:0:(genops.c:885:class_export_put()) final put ffff8981bc97a000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788592795.905882:0:13105:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bc97a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788592795.905897:0:13105:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788592795.906106:0:13105:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8981bc97d000 00000020:02000400:2.0:1788592795.906166:0:13105:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788592796.031522:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592797.056789:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592798.078887:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788592798.994259:0:13258:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788592799.011216:0:13258:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788592799.011312:0:13258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.011334:0:13258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.011341:0:13258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.011377:0:13258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.011424:0:13258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788592799.011432:0:13258:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788592799.011462:0:13258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788592799.011477:0:13258:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bc786300 x1875475147345792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592810 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592799.011495:0:13258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788592799.011502:0:13258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788592799.011509:0:13258:0:(import.c:65:import_set_state_nolock()) ffff898084bc7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788592799.011514:0:13258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788592799.011518:0:13258:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bc786300 x1875475147345792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788592810 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592799.011525:0:13258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788592799.011529:0:13258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:0.0:1788592799.011668:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592799.011676:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.011684:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fa00 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592799.011687:0:5812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.011696:0:5812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592799.011704:0:5812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592799.011718:0:5812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788592799.011721:0:5812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788592799.011723:0:5812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788592799.011741:0:5812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff898184e3d800 00010000:00010000:0.0:1788592799.011745:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.011752:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762fa00/0x27b316f1325109f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f1325109fa expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.011765:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592799.011767:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592799.011769:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592799.012110:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147345792:0@lo:38:kworker.0 00010000:00010000:3.0:1788592799.015311:0:13258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015343:0:13258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015494:0:13258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015503:0:13258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015575:0:13258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592799.015584:0:13258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015607:0:13258:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015613:0:13258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.015619:0:13258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015648:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592799.015657:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015665:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e800 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592799.015670:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015680:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592799.015687:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592799.015693:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788592799.015696:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788592799.015723:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff898184e3d800 00010000:00010000:0.0:1788592799.015728:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015737:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762e800/0x27b316f132510a01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510a08 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015756:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592799.015760:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015766:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf800 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:0.0:1788592799.015769:0:5811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015776:0:5811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788592799.015783:0:5811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592799.015789:0:5811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788592799.015791:0:5811:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788592799.015795:0:5811:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff898184e3d800 00010000:00010000:0.0:1788592799.015797:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592799.015804:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592799.015806:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592799.015807:0:5811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592799.015839:0:13258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592799.015845:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981988bf800/0x27b316f132510c38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510c3f expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592799.015860:0:13258:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788592799.015865:0:13258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788592799.015868:0:13258:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788592799.015897:0:13258:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788592799.015903:0:13258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788592799.015909:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592799.015917:0:13258:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788592799.015922:0:13258:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8980863819c0) has no exports 00000020:00080000:3.0:1788592799.015955:0:13258:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8980863819c0) has no exports 00010000:00010000:0.0:1788592799.016060:0:5812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788592799.019675:0:13258:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8981bf4e9780 - data ffff898087010288/ffff8981bcd98800 00000020:01000000:0.0:1788592799.019858:0:13258:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff898184ea10c0 - data ffff8980847e06c0/ffff8981bc12dc00 00100000:10000000:0.0:1788592799.043600:0:13258:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788592799.081517:0:13258:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325108f7 00000020:00000080:3.0:1788592799.081529:0:13258:0:(genops.c:885:class_export_put()) final put ffff898084bc2000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788592799.081559:0:13258:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89819840e800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788592799.081563:0:13258:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89819840e800 2 00000020:01000004:3.0:1788592799.081566:0:13258:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89819840e800 from lustre-OST0001 00000020:00000080:3.0:1788592799.081591:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592799.081602:0:13258:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788592799.081605:0:13258:0:(genops.c:885:class_export_put()) final put ffff89808418c000/lustre-OST0001_UUID 00000020:00000080:3.0:1788592799.081626:0:13258:0:(genops.c:844:class_export_destroy()) destroying export ffff89808418c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788592799.081634:0:13258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788592799.081746:0:13258:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3766d60d-7279-4c7a-a56f-5f796f49fe93->MGS 00010000:00010000:3.0:1788592799.081763:0:13258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592799.081776:0:13258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592799.081783:0:13258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788592799.081786:0:13258:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788592799.081790:0:13258:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788592799.081805:0:13258:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff898184e3d800 00010000:00010000:3.0:1788592799.081808:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762e600/0x27b316f132510809 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510810 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592799.081826:0:13258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592799.081832:0:13258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592799.081837:0:13258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788592799.081839:0:13258:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788592799.081841:0:13258:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788592799.081850:0:13258:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff898184e3d800 00010000:00010000:3.0:1788592799.081853:0:13258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff89819762e400/0x27b316f132510a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x27b316f132510a4e expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788592799.081871:0:13258:0:(import.c:65:import_set_state_nolock()) ffff898184e3d800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788592799.081876:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788592799.081884:0:13258:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788592799.081886:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788592799.081891:0:13258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788592799.081903:0:13258:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8981bd15dc00 x1875475147345664/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788592803 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788592799.081925:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788592799.081928:0:13258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1788592799.082029:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3766d60d-7279-4c7a-a56f-5f796f49fe93:3282:1875475147345664:0@lo:250:ptlrpcd_00_00.0 00000020:00000080:1.0:1788592799.082270:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc2000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:3.0:1788592799.082312:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788592799.082321:0:13258:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325106ea 00000020:00000080:3.0:1788592799.082326:0:13258:0:(genops.c:885:class_export_put()) final put ffff8981b3802800/3766d60d-7279-4c7a-a56f-5f796f49fe93 00000020:01000000:3.0:1788592799.082367:0:13258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.120@tcp (flags='') 00000020:00000080:3.0:1788592799.082373:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592799.082378:0:13258:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788592799.082383:0:13258:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8981884acd40) has no exports 00000020:00000080:1.0:1788592799.082435:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981b3802800/3766d60d-7279-4c7a-a56f-5f796f49fe93 for MGC192.168.204.120@tcp 10000000:01000000:0.0:1788592799.082485:0:5820:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788592799.082577:0:13258:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.120@tcp: client import never connected 00000100:00080000:3.0:1788592799.082580:0:13258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788592799.082582:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788592799.082585:0:13258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788592799.082587:0:13258:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788592799.082664:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788592799.082670:0:13258:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.120@tcp (uuid 3766d60d-7279-4c7a-a56f-5f796f49fe93) 00000020:01000000:3.0:1788592799.082675:0:13258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788592799.082678:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788592799.082681:0:13258:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788592799.082686:0:13258:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8981c0d8b000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788592799.082691:0:13258:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff898086383380) has exports, disconnecting them 00000020:00080000:3.0:1788592799.082696:0:13258:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8981c0d8b000), last request at 1788592586 00000020:00000080:3.0:1788592799.082700:0:13258:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f132510921 00000020:00080000:3.0:1788592799.082711:0:13258:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8981c0d8b000): rc 0 00000020:00000080:3.0:1788592799.082715:0:13258:0:(genops.c:885:class_export_put()) final put ffff8981c0d8b000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788592799.082885:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898184e3d800 for MGC192.168.204.120@tcp 00000020:00000080:1.0:1788592799.082892:0:8:0:(genops.c:885:class_export_put()) final put ffff8981911f6800/3766d60d-7279-4c7a-a56f-5f796f49fe93 00000020:00000080:1.0:1788592799.082894:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981911f6800/3766d60d-7279-4c7a-a56f-5f796f49fe93 for MGC192.168.204.120@tcp 00000020:01000000:1.0:1788592799.082899:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.120@tcp (3766d60d-7279-4c7a-a56f-5f796f49fe93) 00000020:00000080:1.0:1788592799.088002:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981c0d8b000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788592799.106472:0:13258:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788592799.106482:0:13258:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788592799.106486:0:13258:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788592799.106494:0:13258:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788592799.106570:0:5811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788592799.106711:0:5812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788592799.106883:0:5807:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff898190428600:5807] 1 exiting: rc = 0 00000100:00100000:1.0:1788592799.106964:0:5806:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff898190429e00:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1788592799.107024:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592799.107286:0:11159:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8981bcce7800:11159] 3 exiting: rc = 0 00000020:00000080:1.0:1788592799.107341:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff898084bc7000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1788592799.109495:0:5810:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff898190469600:5810] 2 exiting: rc = 0 00000100:00100000:0.0:1788592799.109775:0:5809:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff898190428200:5809] 1 exiting: rc = 0 00000100:00100000:0.0:1788592799.112791:0:5808:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff898190428e00:5808] 0 exiting: rc = 1 00000100:00100000:1.0:1788592799.112885:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112896:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112903:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112910:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112916:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112923:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112930:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112938:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112959:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112966:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112973:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112980:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112985:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112991:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.112998:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113005:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113012:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113019:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113036:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113041:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113045:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113051:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113056:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113061:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113066:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113072:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113077:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113084:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113090:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113095:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113101:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113107:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113112:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113118:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113123:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113138:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113145:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113150:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113156:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113162:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113168:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113173:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113178:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113191:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113196:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113201:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113216:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113223:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113229:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113236:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113241:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113247:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113252:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113257:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113261:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113266:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113271:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113276:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113281:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113287:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113292:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113298:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113303:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.113310:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788592799.115042:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788592799.115055:0:13258:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788592799.115062:0:13258:0:(genops.c:885:class_export_put()) final put ffff898084bc1000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788592799.115067:0:13258:0:(genops.c:844:class_export_destroy()) destroying export ffff898084bc1000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788592799.115073:0:13258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788592799.115558:0:13258:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89819840e800 1 00000020:00000080:1.0:1788592799.115566:0:13258:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x27b316f1325108c6 00000020:00000080:1.0:1788592799.115572:0:13258:0:(genops.c:885:class_export_put()) final put ffff8981ba558000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788592799.115587:0:13258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788592799.115592:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788592799.115597:0:13258:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788592799.115601:0:13258:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff898187388000) has no exports 00000020:00000080:0.0:1788592799.118513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8981ba558000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788592799.158458:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592799.158476:0:13258:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788592799.158482:0:13258:0:(genops.c:885:class_export_put()) final put ffff8981bc751800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788592799.158488:0:13258:0:(genops.c:844:class_export_destroy()) destroying export ffff8981bc751800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788592799.158496:0:13258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788592799.158738:0:13258:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8981bc755800 00000020:01000000:0.0:1788592799.158764:0:13258:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788592799.158769:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788592799.158774:0:13258:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788592799.158778:0:13258:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8981884a8000) has no exports 00000020:00000080:0.0:1788592799.158803:0:13258:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788592799.158810:0:13258:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788592799.158813:0:13258:0:(genops.c:885:class_export_put()) final put ffff8981904a3800/OSS_uuid 00000020:00000080:0.0:1788592799.158815:0:13258:0:(genops.c:844:class_export_destroy()) destroying export ffff8981904a3800/OSS_uuid for OSS 00000020:01000000:0.0:1788592799.158829:0:13258:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788592799.158912:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff898183e7f200:6677] 1 exiting: rc = 0 00000100:00080000:3.0:1788592799.159907:0:5819:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788592799.163033:0:8688:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8981905ef600:8688] 3 exiting: rc = 0 00000100:00100000:0.0:1788592799.164801:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8981bc74f200:6678] 2 exiting: rc = 0 00000100:00100000:0.0:1788592799.167474:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8981bbf3e000:6676] 0 exiting: rc = 1 00000100:00100000:3.0:1788592799.167744:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167765:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167772:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167781:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167786:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167792:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167798:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167802:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167809:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167814:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167820:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167824:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167830:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167835:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167840:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167845:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167850:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167855:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167860:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167865:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167870:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167876:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167881:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167886:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167892:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167897:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167902:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167906:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167911:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167916:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167922:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167927:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167933:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167940:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167945:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167950:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167963:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167968:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167974:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167979:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167987:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167993:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.167999:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168006:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168011:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168018:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168024:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168030:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168040:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168049:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168058:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168066:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168072:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168089:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168100:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168109:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168117:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168123:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168128:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168134:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168140:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168146:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168151:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.168156:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592799.169697:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff898187281200:6679] 0 exiting: rc = 1 00000100:00100000:1.0:1788592799.169943:0:11473:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8981881b3c00:11473] 2 exiting: rc = 0 00000100:00100000:1.0:1788592799.170032:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff898187280000:6680] 1 exiting: rc = 0 00000100:00100000:3.0:1788592799.175277:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175291:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175297:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175302:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175307:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175313:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175318:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175341:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175369:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175376:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175381:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175386:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175391:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175410:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175415:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175421:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175427:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175432:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175437:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175442:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175446:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175451:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175455:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175461:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175465:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175470:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175475:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175480:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175484:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175490:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175495:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175501:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175506:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175511:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175516:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175521:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175526:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175543:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175549:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175556:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175561:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175566:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175579:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175584:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175590:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175595:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175600:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175605:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175612:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175618:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175623:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175629:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175635:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175640:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175645:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175651:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175660:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175669:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175675:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175680:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175684:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175689:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175694:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.175699:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788592799.181249:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8981bbb60200:6681] 0 exiting: rc = 1 00000100:00100000:1.0:1788592799.186225:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8981859ef200:6683] 2 exiting: rc = 0 00000100:00100000:1.0:1788592799.186740:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8981859eee00:6682] 1 exiting: rc = 0 00000100:00100000:3.0:1788592799.190658:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.190991:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.190997:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191002:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191008:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191013:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191018:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191024:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191029:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191035:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191155:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191161:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191167:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191186:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191192:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191198:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191204:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191211:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191218:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191228:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191248:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191255:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191261:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191266:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191271:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191277:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191282:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191288:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191293:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191299:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191304:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191309:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191315:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191321:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191327:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191332:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191338:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.191343:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.194988:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195068:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195146:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195158:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195164:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195170:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195176:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195182:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195189:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195196:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195216:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195222:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.195958:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196229:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196236:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196243:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196249:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196255:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196261:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196267:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196276:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196282:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196288:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196308:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196316:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788592799.196321:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.204839:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8981bbb61e00:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1788592799.204946:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8981bcea9e00:6685] 1 exiting: rc = 0 00000100:00100000:1.0:1788592799.205007:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205015:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205020:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205026:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205032:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205037:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205044:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205049:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205055:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205060:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205066:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205072:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205089:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205096:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205102:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205108:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205114:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205119:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205126:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205132:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205138:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205143:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205149:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205154:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205159:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205164:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205169:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205175:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205180:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205202:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205207:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205213:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205219:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205224:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205229:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205234:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205239:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205244:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205250:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205255:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205259:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205264:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205269:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205274:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205280:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205285:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205293:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205298:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205303:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205310:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205315:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205320:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205326:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205332:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205338:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205343:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205368:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205375:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205380:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205386:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205402:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205409:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205415:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.205421:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206107:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8981988fc200:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788592799.206195:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8981bcea8800:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788592799.206255:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206262:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206275:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206282:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206290:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206297:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206304:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206312:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206319:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206325:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206331:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206368:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206378:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206385:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206392:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206402:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206410:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206415:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206422:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206428:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206435:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206441:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206447:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206467:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206475:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206481:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206489:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206495:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206501:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206508:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206513:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206521:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206527:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206556:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206562:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206583:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206592:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206597:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206605:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206611:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206617:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206622:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206628:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206633:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206638:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206644:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206650:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206671:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206679:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206684:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206691:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206698:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206703:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206709:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206714:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206719:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206725:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206731:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206736:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206759:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206765:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206772:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206777:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788592799.206792:0:13258:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788592799.226171:0:13258:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788592816.956266:0:13877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788592826.131695:0:14337:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788592826.131702:0:14337:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788592826.132573:0:14337:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8981c0d8e000 00000020:01000004:2.0:1788592826.132597:0:14337:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788592826.132606:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788592826.132700:0:14337:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89819849cd40) 00000020:00000080:2.0:1788592826.132718:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788592826.166551:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788592826.173233:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788592826.175189:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1788592826.175423:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1788592826.175548:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1788592826.175698:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1788592826.175801:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1788592826.176009:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788592826.176103:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1788592826.176404:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:1.0:1788592826.178228:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 592: rc = 0 00100000:10000000:1.0:1788592826.179184:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 592: rc = 0 00100000:10000000:1.0:1788592826.179929:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 596: rc = 0 00100000:10000000:1.0:1788592826.181947:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 596: rc = 0 00100000:10000000:1.0:1788592826.182266:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 596: rc = 0 00100000:10000000:2.0:1788592826.186743:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 596: rc = 0 00100000:10000000:2.0:1788592826.187212:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 596: rc = 0 00100000:10000000:2.0:1788592826.187855:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 596: rc = 0 00100000:10000000:2.0:1788592826.188156:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 596: rc = 0 00100000:10000000:2.0:1788592826.190739:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 596: rc = 0 00100000:10000000:2.0:1788592826.191941:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 596: rc = 0 00100000:10000000:2.0:1788592826.196462:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 596: rc = 0 00100000:10000000:2.0:1788592826.196794:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 596: rc = 0 00100000:10000000:2.0:1788592826.197086:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 596: rc = 0 00100000:10000000:2.0:1788592826.197590:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 376: rc = 0 00100000:10000000:2.0:1788592826.197856:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 376: rc = 0 00100000:10000000:2.0:1788592826.198146:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 376: rc = 0 00100000:10000000:2.0:1788592826.198454:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 376: rc = 0 00100000:10000000:2.0:1788592826.198725:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 376: rc = 0 00100000:10000000:2.0:1788592826.200927:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 376: rc = 0 00100000:10000000:2.0:1788592826.201279:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 376: rc = 0 00100000:10000000:2.0:1788592826.203697:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 376: rc = 0 00100000:10000000:2.0:1788592826.203978:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 376: rc = 0 00100000:10000000:2.0:1788592826.204264:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 376: rc = 0 00100000:10000000:2.0:1788592826.206998:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 376: rc = 0 00100000:10000000:2.0:1788592826.210105:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 376: rc = 0 00100000:10000000:2.0:1788592826.210723:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 376: rc = 0 00100000:10000000:2.0:1788592826.211009:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 376: rc = 0 00100000:10000000:2.0:1788592826.211758:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 376: rc = 0 00100000:10000000:2.0:1788592826.212080:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 376: rc = 0 00100000:10000000:2.0:1788592826.212724:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 376: rc = 0 00100000:10000000:2.0:1788592826.213038:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 376: rc = 0 00100000:10000000:2.0:1788592826.213809:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 376: rc = 0 00100000:10000000:2.0:1788592826.214203:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 376: rc = 0 00100000:10000000:2.0:1788592826.215488:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 376: rc = 0 00100000:10000000:2.0:1788592826.215805:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 376: rc = 0 00100000:10000000:2.0:1788592826.216085:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 376: rc = 0 00100000:10000000:2.0:1788592826.216711:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 376: rc = 0 00100000:10000000:2.0:1788592826.216988:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 376: rc = 0 00100000:10000000:2.0:1788592826.218664:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 376: rc = 0 00100000:10000000:2.0:1788592826.218976:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 376: rc = 0 00100000:10000000:2.0:1788592826.219262:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 376: rc = 0 00100000:10000000:2.0:1788592826.224110:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 376: rc = 0 00100000:10000000:2.0:1788592826.224682:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 376: rc = 0 00100000:10000000:2.0:1788592826.224946:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 376: rc = 0 00100000:10000000:2.0:1788592826.225646:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 376: rc = 0 00100000:10000000:2.0:1788592826.226060:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 43: rc = 0 00100000:10000000:2.0:1788592826.227089:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788592826.228912:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 593: rc = 0 00100000:10000000:2.0:1788592826.229432:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788592826.229512:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 593: rc = 0 00100000:10000000:2.0:1788592826.229715:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788592826.229789:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 593: rc = 0 00100000:10000000:2.0:1788592826.230189:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788592826.230261:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 42: rc = 0 00100000:10000000:2.0:1788592826.232767:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788592826.232868:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 42: rc = 0 00100000:10000000:2.0:1788592826.233110:0:14337:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788592826.234585:0:14337:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 42: rc = 0 00000020:00000080:2.0:1788592826.239535:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788592826.239551:0:14337:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788592826.239583:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f1325119eb 00000020:01000004:2.0:1788592826.239593:0:14337:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788592826.239599:0:14337:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788592826.239605:0:14337:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8981c0d8e000 from MGS 00000020:01000004:2.0:1788592826.239609:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788592826.239625:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff898198498000) 00000020:00000080:2.0:1788592826.239639:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788592826.239708:0:14337:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8981c0d8e000 from MGS, refs=2 00080000:01000000:2.0:1788592826.239715:0:14337:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788592826.239721:0:14337:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f1325119f9 00000100:00100000:2.0:1788592826.239877:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788592826.240038:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788592826.240044:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788592826.243058:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788592826.243073:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788592826.243806:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592826.244033:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788592826.244040:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788592826.244511:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788592826.244520:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788592826.245188:0:14337:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788592826.245197:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788592826.245964:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592826.245968:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592826.245970:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592826.246416:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592826.246419:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592826.246421:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592826.256535:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788592826.258612:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788592826.282909:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788592826.282934:0:14337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788592826.282937:0:14337:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788592826.293493:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788592826.293725:0:14337:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788592826.293842:0:14337:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788592826.300099:0:14337:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788592826.300723:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592826.300956:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788592826.300964:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788592826.309778:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788592826.309794:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788592826.310240:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788592826.310249:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788592826.311034:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788592826.311065:0:14337:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.120@tcp' 00000020:01000004:1.0:1788592826.311067:0:14337:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788592826.311108:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.120@tcp (typ=mgc) 00000020:00000080:1.0:1788592826.311125:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.120@tcp (ffff898086383380) 00000020:00000080:1.0:1788592826.311143:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788592826.311229:0:14337:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8981c0d8e800@MGC192.168.204.120@tcp: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1788592826.311436:0:14337:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.120@tcp-0 is initialized 00000040:01000000:1.0:1788592826.311442:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788592826.311653:0:14351:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788592826.317632:0:14352:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788592826.317737:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.120@tcp (uuid 7e8219ee-ba92-4a43-886c-289e43c7369c) 00000020:00000080:1.0:1788592826.317766:0:14337:0:(genops.c:1385:class_connect()) connect: client 7e8219ee-ba92-4a43-886c-289e43c7369c, cookie 0x27b316f132511a07 00000100:00080000:1.0:1788592826.317783:0:14337:0:(import.c:545:import_select_connection()) MGC192.168.204.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788592826.317790:0:14337:0:(import.c:665:import_select_connection()) MGC192.168.204.120@tcp: import ffff8981c0d8e800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592826.317830:0:14337:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087921500 x1875475147345920/t0(0) o250->MGC192.168.204.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592826.317867:0:14337:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7e8219ee-ba92-4a43-886c-289e43c7369c->MGS 00000020:01000004:1.0:1788592826.317892:0:14337:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788592826.317898:0:14337:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788592826.317914:0:14337:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff898086384d40) 00000020:00000080:1.0:1788592826.317929:0:14337:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788592826.320617:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e8219ee-ba92-4a43-886c-289e43c7369c:3282:1875475147345920:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788592826.320717:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592826.321287:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147345920 00000100:00100000:2.0:1788592826.321578:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147345920 00000100:00100000:2.0:1788592826.321625:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592826.321634:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3282:x1875475147345920:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788592826.321666:0:14347:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7e8219ee-ba92-4a43-886c-289e43c7369c@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:2.0:1788592826.321720:0:14347:0:(genops.c:1385:class_connect()) connect: client 7e8219ee-ba92-4a43-886c-289e43c7369c, cookie 0x27b316f132511a15 00000100:00080000:2.0:1788592826.321892:0:14347:0:(import.c:65:import_set_state_nolock()) ffff8981bc97e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592826.321981:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+5:3282:x1875475147345920:12345-0@lo:250:mount.lustre.0 Request processed in 345us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.321989:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592826.322058:0:3282:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788592826.322068:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.120@tcp: connect to target with instance 0 00000100:00080000:2.0:1788592826.322077:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788592826.322082:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788592826.322085:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8981c0d8e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788592826.322088:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788592826.322100:0:3282:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788592826.322106:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7e8219ee-ba92-4a43-886c-289e43c7369c:3282:1875475147345920:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788592826.334864:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.335094:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788592826.335102:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788592826.349118:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788592826.349137:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788592826.350952:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788592826.350963:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788592826.352802:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592826.352993:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788592826.353000:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788592826.356853:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788592826.356866:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788592826.423822:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.424262:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788592826.424269:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788592826.427473:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788592826.427490:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788592826.429688:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.429976:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592826.429986:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788592826.435620:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788592826.435643:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788592826.436646:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.440800:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592826.440811:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788592826.444136:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788592826.444151:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788592826.447787:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.447979:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788592826.447985:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788592826.448693:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788592826.448702:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788592826.477785:0:14337:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788592826.478035:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788592826.478043:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788592826.480707:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788592826.480730:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788592826.481638:0:14337:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788592826.481650:0:14337:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788592826.483731:0:14337:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788592826.483769:0:14337:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788592826.483777:0:14337:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788592826.483932:0:14337:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788592826.483982:0:14337:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788592826.483987:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788592826.483989:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592826.483990:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592826.483991:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592826.483992:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592826.483993:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592826.483995:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592826.483996:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592826.483998:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592826.483999:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592826.484002:0:14337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788592826.484004:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788592826.484005:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592826.484007:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592826.484008:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592826.484021:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592826.484023:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592826.484024:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592826.484025:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592826.484026:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592826.484028:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788592826.484074:0:14337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788592826.484100:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346048:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788592826.484298:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592826.484410:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bb9ab300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592826.484548:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346048 00000100:00100000:2.0:1788592826.484556:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346048 00000100:00100000:2.0:1788592826.484613:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592826.484623:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+5:14337:x1875475147346048:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788592826.484675:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788592826.484679:0:14350:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788592826.484681:0:14350:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788592826.485029:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788592826.485625:0:14350:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788592826.494056:0:14371:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788592826.494067:0:14371:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788592826.494070:0:14371:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788592826.494106:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788592826.494593:0:14350:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788592826.494608:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788592826.521428:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+5:14337:x1875475147346048:12345-0@lo:253:mount.lustre.0 Request processed in 36718us (37041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.521452:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592826.521486:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788592826.521514:0:14337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788592826.521519:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592826.521532:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592826.521533:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592826.521535:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592826.521536:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592826.521538:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592826.521539:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592826.521541:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592826.521543:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592826.521544:0:14337:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788592826.521575:0:14337:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8981c0d8e000 from lustre-MDT0000 10000000:01000000:2.0:1788592826.521617:0:14337:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788592826.521620:0:14337:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788592826.521625:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff898086383380 10000000:01000000:2.0:1788592826.521629:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592826.521639:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff898086383380 from 1 10000000:01000000:2.0:1788592826.521642:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788592826.521706:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.521719:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.521729:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.521755:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346176:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592826.521817:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592826.521876:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff898189799c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.521900:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346176 00000100:00100000:0.0:1788592826.521911:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346176 00000100:00100000:0.0:1788592826.521963:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592826.521973:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+5:14337:x1875475147346176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592826.521988:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592826.522023:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bccca000/0x27b316f132511a23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511a1c expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.522054:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca000/0x27b316f132511a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511a1c expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.522085:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bccca000/0x27b316f132511a23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511a1c expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.522095:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca000, rc 0) 00000100:00100000:0.0:1788592826.523471:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+6:14337:x1875475147346176:12345-0@lo:101:mount.lustre.0 Request processed in 1492us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.523483:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592826.523581:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346176:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592826.523651:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.523667:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.523884:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592826.523942:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592826.524060:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff898189799c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.527104:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346304 00000100:00100000:1.0:1788592826.527139:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346304 00000100:00100000:1.0:1788592826.527226:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592826.527236:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+6:14337:x1875475147346304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592826.534148:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+6:14337:x1875475147346304:12345-0@lo:501:mount.lustre.0 Request processed in 6900us (10191us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592826.534167:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592826.537802:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346304:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788592826.541922:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788592826.541963:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.541978:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592826.541988:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8981c0d8e000 10000000:01000000:3.0:1788592826.541998:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788592826.542004:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8981c0d8e000 10000000:01000000:3.0:1788592826.542007:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788592826.542041:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8981c0d8e000 from 1 10000000:01000000:3.0:1788592826.542045:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788592826.542092:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542101:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542113:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.542142:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592826.542219:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.542278:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.542301:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346432 00000100:00100000:0.0:1788592826.542312:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346432 00000100:00100000:0.0:1788592826.542429:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592826.542440:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+6:14337:x1875475147346432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592826.542454:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592826.542470:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccb400/0x27b316f132511a31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511a2a expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.542496:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccb400/0x27b316f132511a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511a2a expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.542508:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccb400/0x27b316f132511a31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511a2a expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.542518:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb400, rc 0) 00000100:00100000:0.0:1788592826.542574:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+7:14337:x1875475147346432:12345-0@lo:101:mount.lustre.0 Request processed in 135us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.542582:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592826.542782:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592826.542799:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a31 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542810:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511a31 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592826.542828:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788592826.542846:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a31 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542855:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e8400/0x27b316f132511a2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a31 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592826.542862:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788592826.542878:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788592826.542884:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8981c0d8e000 10000000:01000000:3.0:1788592826.542888:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788592826.542891:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788592826.542894:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788592826.542916:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542924:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.542933:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.542946:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592826.542975:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.543006:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.543079:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346560 00000100:00100000:1.0:1788592826.543084:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346560 00000100:00100000:1.0:1788592826.543137:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788592826.543248:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+7:14337:x1875475147346560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592826.543258:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592826.543271:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bf400/0x27b316f132511a3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511a38 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.543289:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bf400/0x27b316f132511a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511a38 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.543299:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bf400/0x27b316f132511a3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511a38 expref: 8 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.543307:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf400, rc 0) 00000100:00100000:1.0:1788592826.543377:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+8:14337:x1875475147346560:12345-0@lo:101:mount.lustre.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.543384:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788592826.543474:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592826.543486:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a3f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.543502:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511a3f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592826.543557:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592826.543585:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.543615:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819018a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592826.543630:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346688 00000100:00100000:2.0:1788592826.543636:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346688 00000100:00100000:2.0:1788592826.543670:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592826.543676:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+8:14337:x1875475147346688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592826.544106:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14337:x1875475147346688:12345-0@lo:501:mount.lustre.0 Request processed in 429us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.544115:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592826.544325:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592826.544382:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592826.544426:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.544459:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819018a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592826.544521:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346816 00000100:00100000:3.0:1788592826.544526:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346816 00000100:00100000:3.0:1788592826.544566:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592826.544573:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14337:x1875475147346816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592826.544913:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14337:x1875475147346816:12345-0@lo:503:mount.lustre.0 Request processed in 340us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592826.544922:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592826.545069:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147346816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592826.546897:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14372:1875475147346944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592826.546980:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.547041:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819018ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.547062:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147346944 00000100:00100000:1.0:1788592826.547072:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147346944 00000100:00100000:1.0:1788592826.547172:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788592826.547183:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14372:x1875475147346944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788592826.547618:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14372:x1875475147346944:12345-0@lo:502:llog_process_th.0 Request processed in 436us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.547626:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592826.547722:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14372:1875475147346944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592826.547754:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592826.547767:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592826.547769:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788592826.547775:0:14372:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788592826.547778:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592826.547799:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8981bf3e99c0) 00000020:00000080:0.0:1788592826.547820:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788592826.547825:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788592826.547907:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788592826.547916:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132511a4d 00000020:00000080:0.0:1788592826.548996:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788592826.549005:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592826.549022:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592826.549024:0:14372:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788592826.549028:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788592826.549032:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592826.549033:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788592826.549037:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788592826.549049:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8981bf3ecd40) 00000020:00000080:0.0:1788592826.549066:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788592826.549069:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788592826.549071:0:14372:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788592826.549074:0:14372:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788592826.549080:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788592826.549220:0:14372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8981c0d8e000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788592826.549238:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8981bf3eb380) 00000020:00000080:0.0:1788592826.549249:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788592826.549701:0:14372:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788592826.549714:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132511a62 00000020:00000080:0.0:1788592826.549838:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788592826.549911:0:14372:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788592826.549918:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x27b316f132511a69 00080000:01000000:0.0:1788592826.549925:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788592826.549930:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132511a70 00010000:00010000:2.0:1788592826.656341:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788592826.656992:0:14372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788592826.657482:0:14372:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788592826.659254:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8981984999c0) 00000020:00000080:2.0:1788592826.659277:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788592826.659400:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788592826.659408:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132511a7e 00000020:00000080:2.0:1788592826.663643:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788592826.679711:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x27b316f132511a85 00000020:00000080:1.0:1788592826.680789:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788592826.680803:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592826.680811:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592826.680813:0:14372:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788592826.680817:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788592826.680821:0:14372:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788592826.680822:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592826.680824:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788592826.680826:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788592826.680828:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592826.680830:0:14372:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788592826.680832:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592826.680837:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592826.680838:0:14372:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788592826.680842:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788592826.680892:0:14372:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788592826.680914:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592826.680917:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592826.680919:0:14372:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788592826.680921:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788592826.680925:0:14372:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788592826.680928:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592826.680929:0:14372:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788592826.680932:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788592826.680938:0:14372:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:1.0:1788592826.680977:0:14372:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788592826.680980:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788592826.680998:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff898086380000) 00000020:00000080:1.0:1788592826.681023:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788592826.681028:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788592826.681089:0:14372:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788592826.681095:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788592826.681103:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132511a93 00010000:00080000:1.0:1788592826.681149:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89808418e800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1788592826.681403:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788592826.681793:0:14372:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788592826.681837:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788592826.682771:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592826.682832:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788592826.682960:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788592826.688332:0:14376:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788592826.688343:0:14376:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788592826.689925:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788592826.689941:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788592826.689989:0:14372:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788592826.690024:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132511a9a 00000100:00080000:2.0:1788592826.690038:0:14372:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788592826.690045:0:14372:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89808418e800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1788592826.690091:0:14372:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc5d1500 x1875475147347072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592826.690165:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147347072:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788592826.690235:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475147347072 offset 0 length 520: 4 00000100:00080000:2.0:1788592826.690597:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788592826.690679:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592826.690683:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592826.690686:0:14372:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788592826.690688:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788592826.690691:0:14372:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788592826.690693:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592826.690695:0:14372:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788592826.690696:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788592826.690782:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592826.690784:0:14372:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788592826.690788:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592826.690793:0:14372:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788592826.690796:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592826.690798:0:14372:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788592826.690801:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788592826.690805:0:14372:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.120@tcp to nid 0x20000c0a8cc78 (192.168.204.120@tcp) 00000020:01000000:2.0:1788592826.690827:0:14372:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788592826.690830:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592826.690842:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89819849b380) 00000020:00000080:2.0:1788592826.690859:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788592826.690864:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788592826.690929:0:14372:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788592826.690937:0:14372:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788592826.690944:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x27b316f132511aa8 00010000:00080000:2.0:1788592826.690976:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898084810800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:2.0:1788592826.691225:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788592826.691533:0:14372:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788592826.691577:0:14372:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788592826.694769:0:14372:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592826.695254:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788592826.695346:0:14372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788592826.698088:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788592826.698097:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788592826.701712:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788592826.701745:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788592826.701880:0:14372:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788592826.701905:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132511aaf 00000100:00080000:3.0:1788592826.701918:0:14372:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592826.701926:0:14372:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592826.701969:0:14372:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc784380 x1875475147347200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592826.702174:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147347200:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788592826.702235:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475147347200 offset 0 length 520: 4 00000100:00080000:3.0:1788592826.702294:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788592826.702459:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592826.702464:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.702466:0:14372:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788592826.702469:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592826.702473:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.702474:0:14372:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592826.702477:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592826.702479:0:14372:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592826.702481:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592826.702483:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.702485:0:14372:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788592826.702487:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592826.702489:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.702490:0:14372:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788592826.702494:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788592826.702525:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14372:1875475147347328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592826.702585:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.702622:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592826.703862:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347328 00000100:00100000:3.0:1788592826.703876:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347328 00000100:00100000:3.0:1788592826.703944:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788592826.703954:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14372:x1875475147347328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592826.704582:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14372:x1875475147347328:12345-0@lo:502:llog_process_th.0 Request processed in 627us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592826.704591:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592826.705133:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14372:1875475147347328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788592826.705186:0:14372:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788592826.705194:0:14372:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788592826.705196:0:14372:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788592826.705202:0:14372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788592826.705485:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788592826.705504:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788592826.705684:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a3f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.705696:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9c00/0x27b316f132511a38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a3f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592826.705719:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8981c0d8e000 from 1 10000000:01000000:3.0:1788592826.705722:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592826.705758:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.705766:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.705776:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.705808:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592826.705863:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.705909:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.706055:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347456 00000100:00100000:1.0:1788592826.706062:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347456 00000100:00100000:1.0:1788592826.706110:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592826.706119:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+9:14337:x1875475147347456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592826.706132:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592826.706148:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511ab6 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.706172:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511ab6 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.706197:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ab6 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.706207:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be200, rc 0) 00000100:00100000:1.0:1788592826.706256:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+10:14337:x1875475147347456:12345-0@lo:101:mount.lustre.0 Request processed in 138us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.706263:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788592826.706489:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592826.706503:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.706523:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.707338:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347584:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788592826.707466:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.707678:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.707893:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347584 00000100:00100000:0.0:1788592826.707900:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347584 00000100:00100000:0.0:1788592826.707989:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592826.708000:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+10:14337:x1875475147347584:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788592826.708078:0:14349:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788592826.708086:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788592826.708171:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+10:14337:x1875475147347584:12345-0@lo:256:mount.lustre.0 Request processed in 174us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.708179:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592826.708466:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347584:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788592826.709339:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592826.709383:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.709395:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592826.709405:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8981c0d8e000 from 1 10000000:01000000:3.0:1788592826.709408:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592826.709446:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.709454:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.709462:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.709484:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788592826.709531:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.709983:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.710168:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347712 00000100:00100000:1.0:1788592826.710176:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347712 00000100:00100000:1.0:1788592826.710221:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592826.710230:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+10:14337:x1875475147347712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592826.710245:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592826.710262:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511ac4 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.710301:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511ac4 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.710313:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ac4 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.710330:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bec00, rc 0) 00000100:00100000:1.0:1788592826.710681:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147347712:12345-0@lo:101:mount.lustre.0 Request processed in 452us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.710689:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788592826.710762:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592826.710843:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592826.710854:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.710923:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592826.710951:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.711023:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.711163:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347840 00000100:00100000:0.0:1788592826.711169:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347840 00000100:00100000:0.0:1788592826.711246:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788592826.711254:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147347840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592826.711985:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147347840:12345-0@lo:501:mount.lustre.0 Request processed in 731us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.711994:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592826.712263:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592826.712311:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592826.712413:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.712485:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.712533:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147347968 00000100:00100000:0.0:1788592826.712675:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147347968 00000100:00100000:0.0:1788592826.712753:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788592826.712761:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147347968:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592826.712946:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147347968:12345-0@lo:503:mount.lustre.0 Request processed in 185us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.712952:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788592826.713054:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147347968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592826.713696:0:14380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14380:1875475147348096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592826.713741:0:14380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.713894:0:14380:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592826.713942:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348096 00000100:00100000:2.0:1788592826.713948:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348096 00000100:00100000:2.0:1788592826.713979:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788592826.713988:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14380:x1875475147348096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788592826.714406:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14380:x1875475147348096:12345-0@lo:502:llog_process_th.0 Request processed in 418us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.714415:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788592826.714966:0:14380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14380:1875475147348096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592826.715001:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592826.715021:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.715023:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788592826.715039:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8981c0d8e000 00000020:00000080:3.0:1788592826.715158:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592826.715172:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592826.715181:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.715183:0:14380:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788592826.715187:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592826.715190:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.715192:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788592826.715196:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8981c0d8e000 00000020:00000080:3.0:1788592826.715198:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592826.715252:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592826.715255:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.715257:0:14380:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788592826.715259:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592826.715262:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.715263:0:14380:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592826.715267:0:14380:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8981c0d8e000 00000020:00000080:3.0:1788592826.715268:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788592826.715311:0:14380:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14380:1875475147348224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592826.715382:0:14380:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592826.715424:0:14380:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808675d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.715435:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348224 00000100:00100000:0.0:1788592826.715443:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348224 00000100:00100000:0.0:1788592826.715491:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788592826.715670:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14380:x1875475147348224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592826.716082:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14380:x1875475147348224:12345-0@lo:502:llog_process_th.0 Request processed in 581us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.716091:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592826.717231:0:14380:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14380:1875475147348224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788592826.717276:0:14380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592826.717286:0:14380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592826.717288:0:14380:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788592826.717292:0:14380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788592826.717403:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788592826.717428:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592826.717451:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.717464:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592826.717520:0:14337:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788592826.717524:0:14337:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8981c0d8e000 10000000:01000000:0.0:1788592826.717528:0:14337:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8981c0d8e000 10000000:01000000:0.0:1788592826.717532:0:14337:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592826.717540:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8981c0d8e000 from 1 10000000:01000000:0.0:1788592826.717543:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788592826.717582:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.717591:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.717601:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592826.717637:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788592826.717693:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.718109:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348352 00000100:00100000:0.0:1788592826.718118:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348352 00000100:00100000:0.0:1788592826.718168:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592826.718177:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147348352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592826.718191:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592826.718204:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccbe00/0x27b316f132511ad9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511ad2 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.720416:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccbe00/0x27b316f132511ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511ad2 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.720436:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccbe00/0x27b316f132511ad9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ad2 expref: 12 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.720447:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbe00, rc 0) 00000100:00100000:0.0:1788592826.720532:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147348352:12345-0@lo:101:mount.lustre.0 Request processed in 2355us (2838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.720543:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788592826.720633:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981894c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.720664:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592826.721409:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ad9 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592826.721426:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511ad9 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592826.721540:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592826.721593:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.721638:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981894c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.721711:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348480 00000100:00100000:1.0:1788592826.721719:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348480 00000100:00100000:1.0:1788592826.721842:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592826.721857:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147348480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592826.722160:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147348480:12345-0@lo:501:mount.lustre.0 Request processed in 306us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.722168:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788592826.722186:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592826.722335:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592826.722404:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592826.722438:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348608 00000100:00100000:0.0:1788592826.722440:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981894c09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.722444:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348608 00000100:00100000:1.0:1788592826.722476:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788592826.722484:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147348608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592826.723117:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147348608:12345-0@lo:503:mount.lustre.0 Request processed in 632us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.723126:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788592826.723382:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147348608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592826.724246:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14381:1875475147348736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592826.724302:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.724371:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981894c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592826.724718:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348736 00000100:00100000:3.0:1788592826.724726:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348736 00000100:00100000:3.0:1788592826.724766:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788592826.724775:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14381:x1875475147348736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788592826.725104:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14381:x1875475147348736:12345-0@lo:502:llog_process_th.0 Request processed in 329us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592826.725112:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788592826.725753:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14381:1875475147348736:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788592826.726114:0:14381:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788592826.726134:0:14381:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8981bf3e8000) 00000020:00000080:0.0:1788592826.726160:0:14381:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788592826.726256:0:14381:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8981c0d8e000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592826.726261:0:14381:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8981c0d8e000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788592826.726264:0:14381:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8981c0d8e000 4 00010000:00080000:0.0:1788592826.726296:0:14381:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898197206800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.120@tcp at head 00010000:00010000:0.0:1788592826.737392:0:14381:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788592826.742183:0:14381:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788592826.742231:0:14381:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788592826.742246:0:14381:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x27b316f132511ae7 00000100:00080000:0.0:1788592826.742260:0:14381:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788592826.742275:0:14381:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff898197206800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:0.0:1788592826.742321:0:14381:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bd15dc00 x1875475147348864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592826.742388:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147348864:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788592826.742465:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788592826.742529:0:14381:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788592826.745203:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14381:1875475147348992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592826.745294:0:14381:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592826.745341:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981894c0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592826.745386:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348992 00000100:00100000:0.0:1788592826.745393:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348992 00000100:00100000:0.0:1788592826.745442:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592826.745451:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14381:x1875475147348992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788592826.745902:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14381:x1875475147348992:12345-0@lo:502:llog_process_th.0 Request processed in 449us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592826.745910:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788592826.745969:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7e8219ee-ba92-4a43-886c-289e43c7369c:14381:1875475147348992:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788592826.745997:0:14381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:1.0:1788592826.751830:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147348864 00000100:00100000:1.0:1788592826.751844:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147348864 00000100:00100000:1.0:1788592826.751893:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592826.751902:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147348864:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592826.752030:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3282:x1875475147348864:12345-0@lo:38:llog_process_th.0 Request processed in 127us (9564us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788592826.752038:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788592826.752064:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788592826.752104:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788592826.752126:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ad9 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.752138:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bccca600/0x27b316f132511ad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ad9 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788592826.752200:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788592826.752207:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592826.752208:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592826.752209:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592826.752210:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592826.752211:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592826.752212:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592826.752214:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592826.752216:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592826.752217:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788592826.752222:0:14337:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788592826.752225:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788592826.752226:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788592826.752227:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592826.752228:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592826.752229:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592826.752230:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592826.752231:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788592826.752232:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788592826.752233:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592826.752234:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788592826.752258:0:14337:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788592826.752277:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147349120:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788592826.752338:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592826.752394:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.752420:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349120 00000100:00100000:1.0:1788592826.752424:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349120 00000100:00100000:1.0:1788592826.752460:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788592826.752466:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14337:x1875475147349120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788592826.752630:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788592826.752648:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788592826.753173:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592826.753183:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898197206800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592826.753188:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788592826.753192:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147348864:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788592826.822910:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788592826.822965:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788592826.823055:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788592826.823061:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788592826.823087:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.823107:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ab6 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.823115:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.823235:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.823253:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 12 pid: 14350 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.823270:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147349248:0@lo:104: 00000100:00100000:2.0:1788592826.823343:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592826.823464:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981c2150180 going to sleep for 11 seconds 00000100:00100000:1.0:1788592826.823707:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349248 00000100:00100000:1.0:1788592826.823717:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349248 00000100:00100000:1.0:1788592826.823775:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788592826.823784:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147349248:12345-0@lo:104: 00000100:00100000:3.0:1788592826.823793:0:14339:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:1.0:1788592826.823799:0:14338:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592826.823803:0:14339:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788592826.823868:0:14338:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788592826.823874:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147349248:12345-0@lo:104: Request processed in 92us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.823883:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788592826.823906:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592826.823913:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.823921:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592826.823927:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.823937:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592826.823946:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592826.823953:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788592826.823983:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.823996:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788592826.824033:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.824034:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147349248:0@lo:104: 00010000:00010000:1.0:1788592826.824046:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511ab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511abd expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592826.824069:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592826.824071:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592826.824073:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592826.824074:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592826.824105:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147349376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592826.824213:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592826.824278:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349376 00000100:00100000:2.0:1788592826.824283:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349376 00010000:00010000:2.0:1788592826.824302:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 13 pid: 14350 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.824326:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592826.824333:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+13:3285:x1875475147349376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592826.824378:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592826.824384:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 13 pid: 14350 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824395:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 13 pid: 14350 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824409:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981988be200/0x27b316f132511abd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511ab6 expref: 13 pid: 14350 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824421:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824429:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592826.824444:0:14340:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001383408s 00010000:00010000:2.0:1788592826.824449:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824456:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824468:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824475:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824480:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592826.824483:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824489:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824502:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824512:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592826.824543:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3285:x1875475147349376:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592826.824550:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788592826.824568:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824576:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592826.824582:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4000/0x27b316f132511aee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592826.824619:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147349376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592826.848980:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14337:x1875475147349120:12345-0@lo:253:mount.lustre.0 Request processed in 96503us (96632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592826.848997:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592826.849108:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:14337:1875475147349120:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788592826.849125:0:14337:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788592826.849128:0:14337:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592826.849130:0:14337:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788592826.849131:0:14337:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592826.849133:0:14337:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592826.849134:0:14337:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592826.849135:0:14337:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592826.849136:0:14337:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788592826.849138:0:14337:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788592826.849208:0:14337:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592826.849211:0:14337:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788592826.849227:0:14337:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788592826.858077:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592826.858252:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592826.860975:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592826.861196:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592826.861753:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592826.861908:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592826.868716:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592826.868892:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592826.869170:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592826.872062:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788592826.873951:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592826.875088:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788592826.963598:0:14337:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788592826.967114:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788592826.967396:0:14393:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788592826.967516:0:14393:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788592826.969729:0:14392:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788592826.969736:0:14392:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788592826.972770:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788592826.972985:0:14337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592826.973848:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788592826.973935:0:14393:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788592826.973940:0:14393:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:3.0:1788592826.974416:0:14337:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788592826.974432:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788592826.976810:0:14337:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788592826.978035:0:14337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788592826.979247:0:14337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788592826.979303:0:14337:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788592826.982512:0:14337:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788592826.993694:0:14337:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788592827.022431:0:14337:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788592827.022479:0:14337:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafe201883988 00100000:10000000:3.0:1788592827.022490:0:14337:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788592827.024198:0:14337:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788592827.024217:0:14337:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788592827.024235:0:14337:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788592827.024253:0:14337:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788592827.263053:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788592827.843057:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788592828.031795:0:14352:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592828.031805:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8981c0d8e000 from 6 10000000:01000000:3.0:1788592828.031811:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592828.031864:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592828.031887:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592828.031899:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592828.031929:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147349504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592828.032024:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592828.032083:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818484a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592828.032156:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349504 00000100:00100000:0.0:1788592828.032165:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349504 00000100:00100000:0.0:1788592828.032233:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788592828.032244:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14352:x1875475147349504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592828.032257:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592828.032281:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511af5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592828.032305:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511af5 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592828.032316:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511af5 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592828.032325:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592828.032386:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147349504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592828.032393:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592828.033125:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147349504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592828.033144:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592828.033155:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592828.033215:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147349632:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788592828.033257:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592828.033297:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818484a600 going to sleep for 11 seconds 00000100:00100000:0.0:1788592828.033398:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349632 00000100:00100000:0.0:1788592828.033404:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349632 00000100:00100000:0.0:1788592828.033437:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788592828.033445:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147349632:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592828.033472:0:14350:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592828.033490:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592828.033499:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788592828.033581:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147349632:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592828.033588:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788592828.034112:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147349632:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788592828.034163:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592828.034172:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592828.034181:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592828.288085:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788592828.865459:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592829.310616:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592830.334916:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592831.358941:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592831.857344:0:14636:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788592832.258364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592832.258372:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788592832.258375:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592832.258378:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788592832.258381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788592832.258396:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788592832.258401:0:8:0:(import.c:65:import_set_state_nolock()) ffff898197206800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592832.258415:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff898197206800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592832.258443:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087921c00 x1875475147349888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592832.258484:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147349760:0@lo:400:kworker.0 00000100:00100000:1.0:1788592832.258593:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592832.259235:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147349888:0@lo:38:kworker.0 00000100:00100000:0.0:1788592832.259284:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592832.259347:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349888 00000100:00100000:0.0:1788592832.259373:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349888 00000100:00100000:0.0:1788592832.259411:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592832.259429:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875475147349888:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788592832.259484:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:0.0:1788592832.259530:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x27b316f132511b03 00000004:00100000:0.0:1788592832.259552:0:14356:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788592832.260804:0:14356:0:(import.c:65:import_set_state_nolock()) ffff8981bc82f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592832.260919:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875475147349888:12345-0@lo:38:kworker.0 Request processed in 1487us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592832.260931:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788592832.261914:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff898087921c00 x1875475147349888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592832.261941:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788592832.261951:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788592832.261957:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788592832.261960:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898197206800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788592832.261969:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875475147349888:0@lo:38:kworker.0 00000100:00100000:0.0:1788592832.269408:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147349760 00000100:00100000:0.0:1788592832.269424:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147349760 00000100:00100000:0.0:1788592832.269490:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592832.269516:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3286:x1875475147349760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592832.269630:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3286:x1875475147349760:12345-0@lo:400:kworker.0 Request processed in 130us (11037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592832.269639:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788592832.269704:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147349760:0@lo:400:kworker.0 00010000:00010000:2.0:1788592832.382775:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592833.406745:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592834.430596:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788592835.224644:0:14786:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4a316b50 20000000:00000080:1.0:1788592835.224670:0:14786:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff898184297000 uarg=0000000000000000 20000000:01000000:1.0:1788592835.224710:0:14786:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788592835.224719:0:14786:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788592835.224724:0:14786:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788592835.228553:0:14787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788592835.232089:0:14786:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788592835.246270:0:14786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788592835.246627:0:14786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592835.246651:0:14786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ac4 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592835.246661:0:14786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592835.246715:0:14786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 11 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592835.246754:0:14786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 11 pid: 14350 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592835.246782:0:14786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1875475147350016:0@lo:104: 00000100:00100000:0.0:1788592835.247093:0:14786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592835.247209:0:14786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592835.247273:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350016 00000100:00100000:3.0:1788592835.247283:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350016 00000100:00100000:3.0:1788592835.247345:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592835.249288:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14786:x1875475147350016:12345-0@lo:104: 00010000:00010000:3.0:1788592835.249311:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592835.249855:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592835.249863:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14786:x1875475147350016:12345-0@lo:104: Request processed in 590us (2770us total) trans 0 rc 0/0 00010000:00010000:1.0:1788592835.249926:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592835.249944:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.249952:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9800 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:1.0:1788592835.249972:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.249983:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788592835.249991:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592835.249998:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788592835.250080:0:14786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14786:1875475147350016:0@lo:104: 00010000:00010000:0.0:1788592835.250107:0:14786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.250178:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.250186:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788592835.250261:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147350144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592835.250303:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788592835.250431:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.250439:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9800/0x27b316f132511ac4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511acb expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592835.250468:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592835.250471:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592835.250472:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592835.251516:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350144 00000100:00100000:2.0:1788592835.251536:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350144 00010000:00010000:2.0:1788592835.251589:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 12 pid: 14350 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592835.251631:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592835.251736:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592835.251748:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3283:x1875475147350144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592835.251767:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592835.251774:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 12 pid: 14350 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.251789:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 12 pid: 14350 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252143:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981988bec00/0x27b316f132511acb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511ac4 expref: 12 pid: 14350 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252166:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252177:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252202:0:14340:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252210:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252219:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252228:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252249:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592835.252253:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.252263:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592835.256085:0:14786:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.256085:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592835.256131:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788592835.256208:0:14786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592835.256217:0:14786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bccca200/0x27b316f132511b0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592835.256259:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+11:3283:x1875475147350144:12345-0@lo:103:ldlm_bl.0 Request processed in 4509us (5951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592835.256273:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592835.257200:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147350144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592835.454617:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592836.352714:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592826/real 1788592826] req@ffff8981bc784380 x1875475147347200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592836 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592836.352749:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8981bc784380 x1875475147347200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592836 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592836.352761:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592826/real 1788592826] req@ffff8981bc5d1500 x1875475147347072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592836 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592836.352808:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8981bc5d1500 x1875475147347072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592836 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788592836.352840:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592836.352863:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592836.352867:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147347200:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788592836.352874:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89808418e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788592836.352880:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788592836.352884:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147347072:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788592836.353329:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592836.353334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788592836.353338:0:36:0:(import.c:65:import_set_state_nolock()) ffff89808418e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592836.353343:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1788592836.353376:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592836.353384:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89808418e800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592836.353407:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc784380 x1875475147350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592836.353429:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592836.353431:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788592836.353438:0:36:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788592836.353441:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 400 00000100:00080000:3.0:1788592836.353444:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788592836.353447:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592836.353457:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc786d80 x1875475147350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592836.353688:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592836.353705:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147350272:0@lo:400:kworker.0 00000100:00100000:2.0:1788592836.353790:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592836.353871:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147350656:0@lo:400:kworker.0 00000100:00100000:2.0:1788592836.353910:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592836.353965:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350656 00000100:00100000:2.0:1788592836.353974:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350656 00000100:00100000:2.0:1788592836.354040:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592836.354051:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147350656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592836.354105:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147350656:12345-0@lo:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592836.354113:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788592836.354165:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8981bc787100 x1875475147350656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592836.354177:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147350656:0@lo:400:kworker.0 00000100:00100000:3.0:1788592836.354916:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350272 00000100:00100000:3.0:1788592836.354924:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350272 00000100:00100000:3.0:1788592836.354962:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592836.354969:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:3283:x1875475147350272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592836.355019:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+11:3283:x1875475147350272:12345-0@lo:400:kworker.0 Request processed in 50us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592836.355036:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788592836.355179:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147350400:0@lo:8:kworker.0 00000400:00000100:1.0:1788592836.355213:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475147350400 offset 0 length 520: 4 00000100:00100000:1.0:1788592836.355245:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147350528:0@lo:8:kworker.0 00000400:00000100:1.0:1788592836.355267:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875475147350528 offset 0 length 520: 4 00000100:00100000:2.0:1788592836.356970:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147350272:0@lo:400:kworker.0 00010000:00010000:2.0:1788592836.480206:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788592837.246772:0:14352:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592837.246783:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8981c0d8e000 from 10 10000000:01000000:0.0:1788592837.246790:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592837.246881:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592837.246895:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592837.246909:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592837.246940:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147350784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592837.247567:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592837.249079:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350784 00000100:00100000:3.0:1788592837.249101:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350784 00000100:00100000:3.0:1788592837.249236:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788592837.249250:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+11:14352:x1875475147350784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592837.249274:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788592837.249301:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981a0b9f300 going to sleep for 11 seconds 00010000:00010000:3.0:1788592837.249302:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b11 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592837.249392:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b11 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592837.249406:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b11 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592837.249418:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e8a00, rc 0) 00000100:00100000:3.0:1788592837.249508:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147350784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592837.249516:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788592837.249610:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147350784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592837.252120:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592837.252146:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592837.252257:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147350912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592837.252336:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592837.252400:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981a0b9f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592837.252416:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147350912 00000100:00100000:2.0:1788592837.252427:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147350912 00000100:00100000:2.0:1788592837.252489:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788592837.252500:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147350912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592837.252873:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147350912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592837.252882:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788592837.256016:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147350912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592837.256108:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147351040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788592837.256218:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592837.256688:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981a0b9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592837.257244:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351040 00000100:00100000:3.0:1788592837.257256:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351040 00000100:00100000:3.0:1788592837.257329:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788592837.257340:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147351040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592837.257652:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+12:14352:x1875475147351040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 313us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592837.257662:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788592837.259173:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147351040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788592837.263483:0:14848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788592837.263627:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788592837.263661:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592837.263679:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592837.263695:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592837.503945:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788592838.081788:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592838.526829:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592839.554544:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592840.576401:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788592841.171199:0:15036:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788592841.171204:0:15036:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788592841.171343:0:15036:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff89819718b800 00000020:01000004:1.0:1788592841.171391:0:15036:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788592841.171407:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788592841.171424:0:15036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8980863819c0) 00000020:00000080:1.0:1788592841.171442:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788592841.207135:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788592841.207681:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788592841.210052:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788592841.210544:0:15036:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788592841.210804:0:15036:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788592841.211763:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 77: rc = 0 00100000:10000000:2.0:1788592841.211927:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 77: rc = 0 00100000:10000000:2.0:1788592841.212023:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 77: rc = 0 00100000:10000000:2.0:1788592841.214038:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 567: rc = 0 00100000:10000000:2.0:1788592841.215777:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 567: rc = 0 00100000:10000000:2.0:1788592841.216083:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 567: rc = 0 00100000:10000000:2.0:1788592841.217160:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 567: rc = 0 00100000:10000000:2.0:1788592841.221075:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 567: rc = 0 00100000:10000000:2.0:1788592841.221637:0:15036:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 567: rc = 0 00000020:00000080:2.0:1788592841.222776:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788592841.222792:0:15036:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788592841.222806:0:15036:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27b316f132511b26 00000020:01000004:2.0:1788592841.222816:0:15036:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788592841.222843:0:15036:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788592841.222849:0:15036:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788592841.222855:0:15036:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788592841.222861:0:15036:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788592841.222893:0:15036:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89818431cd40) 00000020:00000080:2.0:1788592841.222906:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788592841.232757:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592841.233011:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788592841.233019:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788592841.236684:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788592841.236700:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788592841.240769:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788592841.240787:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788592841.247531:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592841.248189:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788592841.248199:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788592841.250584:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788592841.250601:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788592841.281512:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788592841.285098:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788592841.285107:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788592841.291341:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788592841.291395:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788592841.292821:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788592841.292834:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788592841.308703:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788592841.308975:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788592841.308985:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788592841.315792:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788592841.315815:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788592841.436496:0:15036:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788592841.437668:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788592841.437690:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788592841.440702:0:15036:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788592841.440717:0:15036:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788592841.441422:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788592841.441453:0:15036:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788592841.441464:0:15036:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000100:00080000:3.0:1788592841.470541:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592841.470548:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592841.470551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592841.470554:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788592841.470604:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592841.470629:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147351168:0@lo:400:kworker.0 00000100:00100000:3.0:1788592841.470713:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592841.470798:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147351296:0@lo:400:kworker.0 00000100:00100000:3.0:1788592841.470841:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592841.470864:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351168 00000100:00100000:1.0:1788592841.470891:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351168 00000100:00100000:3.0:1788592841.470892:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351296 00000100:00100000:3.0:1788592841.470898:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351296 00000100:00100000:1.0:1788592841.470951:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788592841.470955:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592841.470965:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3285:x1875475147351168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592841.470968:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147351296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592841.471039:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147351296:12345-0@lo:400:kworker.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.471050:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592841.471052:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:3285:x1875475147351168:12345-0@lo:400:kworker.0 Request processed in 87us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592841.471063:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788592841.471110:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8981bc784a80 x1875475147351296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592841.471124:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147351296:0@lo:400:kworker.0 00000040:01000000:2.0:1788592841.477475:0:15036:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788592841.477518:0:15036:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788592841.477522:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788592841.477524:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592841.477526:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592841.477527:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592841.477529:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592841.477531:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592841.477532:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592841.477534:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592841.477536:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592841.477540:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788592841.477542:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592841.477544:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788592841.477545:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592841.477546:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592841.477547:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592841.477549:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592841.477550:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592841.477551:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592841.477552:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592841.477584:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788592841.477607:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788592841.482901:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147351168:0@lo:400:kworker.0 00000100:00100000:2.0:1788592841.487540:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.487863:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788592841.491343:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351424 00000100:00100000:0.0:1788592841.491375:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351424 00000100:00100000:0.0:1788592841.491511:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592841.491524:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:15036:x1875475147351424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788592841.491585:0:14347:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788592841.491589:0:14347:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788592841.491592:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788592841.501065:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:15036:x1875475147351424:12345-0@lo:253:mount.lustre.0 Request processed in 9534us (13524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.501081:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788592841.501318:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351424:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788592841.501384:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788592841.501388:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788592841.501390:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592841.501391:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592841.501393:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592841.501394:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592841.501395:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592841.501396:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592841.501398:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592841.501400:0:15036:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788592841.501423:0:15036:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89819718b800 from lustre-OST0000 10000000:01000000:0.0:1788592841.501452:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788592841.501456:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788592841.501464:0:15036:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff898086383380 local copy 00010000:00010000:0.0:1788592841.501476:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592841.501814:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592841.501853:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.501886:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592841.501957:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351552 00000100:00100000:1.0:1788592841.501964:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351552 00000100:00100000:1.0:1788592841.502016:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788592841.502026:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:15036:x1875475147351552:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592841.502417:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+12:15036:x1875475147351552:12345-0@lo:501:mount.lustre.0 Request processed in 392us (562us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592841.502425:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788592841.502507:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351552:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788592841.502524:0:15036:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788592841.504314:0:15036:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788592841.504330:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.504342:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592841.504391:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89819718b800 10000000:01000000:0.0:1788592841.504415:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788592841.504422:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff898086383380 10000000:01000000:0.0:1788592841.504424:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788592841.504429:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff898086383380 from 1 10000000:01000000:0.0:1788592841.504432:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788592841.504474:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.504483:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.504495:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592841.504916:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788592841.504983:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.505040:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881de840 going to sleep for 11 seconds 00000100:00100000:2.0:1788592841.505328:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351680 00000100:00100000:2.0:1788592841.505336:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351680 00000100:00100000:2.0:1788592841.505418:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788592841.505427:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+12:15036:x1875475147351680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592841.505450:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592841.505467:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5e00/0x27b316f132511b3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b34 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.505491:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5e00/0x27b316f132511b3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b34 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.505502:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5e00/0x27b316f132511b3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b34 expref: 13 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.505511:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5e00, rc 0) 00000100:00100000:2.0:1788592841.505560:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+13:15036:x1875475147351680:12345-0@lo:101:mount.lustre.0 Request processed in 134us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.505566:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788592841.505711:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592841.505740:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b3b expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.505750:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b3b expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592841.505775:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788592841.505789:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b3b expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.505796:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccaa00/0x27b316f132511b34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b3b expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592841.505815:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788592841.505819:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788592841.505825:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788592841.505827:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788592841.505849:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.505857:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.505864:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592841.505879:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788592841.505907:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.506014:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981881de840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592841.508319:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351808 00000100:00100000:1.0:1788592841.508336:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351808 00000100:00100000:1.0:1788592841.508441:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788592841.508453:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+13:15036:x1875475147351808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592841.508469:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592841.508489:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bfc00/0x27b316f132511b49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b42 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.508517:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bfc00/0x27b316f132511b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b42 expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.508529:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bfc00/0x27b316f132511b49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b42 expref: 14 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.508539:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfc00, rc 0) 00000100:00100000:1.0:1788592841.508637:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147351808:12345-0@lo:101:mount.lustre.0 Request processed in 187us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592841.508645:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788592841.508982:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592841.509003:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b49 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.509013:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b49 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592841.509827:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788592841.513461:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592841.517852:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788592841.517963:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788592841.517997:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788592841.518044:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788592841.518083:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788592841.518117:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788592841.518548:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788592841.518558:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788592841.518681:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592841.518782:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.518831:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236600 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.518893:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147351936 00000100:00100000:3.0:1788592841.518908:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147351936 00000100:00100000:3.0:1788592841.518976:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788592841.518985:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147351936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592841.519651:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147351936:12345-0@lo:501:mount.lustre.0 Request processed in 665us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.519658:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788592841.519764:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147351936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592841.519806:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592841.519849:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.519879:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236600 going to sleep for 11 seconds 00000100:00100000:2.0:1788592841.519946:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352064 00000100:00100000:2.0:1788592841.519952:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352064 00000100:00100000:2.0:1788592841.519988:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788592841.519996:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592841.520412:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352064:12345-0@lo:503:mount.lustre.0 Request processed in 416us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.520420:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788592841.520687:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788592841.521689:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788592841.521813:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592841.521881:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592841.521979:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818484ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592841.522033:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352192 00000100:00100000:0.0:1788592841.522039:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352192 00000100:00100000:0.0:1788592841.522151:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788592841.522161:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592841.522415:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352192:12345-0@lo:502:mount.lustre.0 Request processed in 255us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592841.522423:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788592841.522500:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592841.522788:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788592841.522841:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788592841.522874:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788592841.522918:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788592841.522953:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788592841.522983:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788592841.523026:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788592841.523063:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788592841.523097:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788592841.523143:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788592841.523175:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788592841.523219:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788592841.523252:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592841.523297:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592841.523681:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818484ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592841.524281:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352320 00000100:00100000:2.0:1788592841.524291:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352320 00000100:00100000:2.0:1788592841.524336:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788592841.524345:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592841.524612:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352320:12345-0@lo:502:mount.lustre.0 Request processed in 267us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.524629:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788592841.524752:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788592841.524863:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788592841.524877:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788592841.525993:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788592841.526002:0:15050:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788592841.526008:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.526010:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788592841.526015:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788592841.526031:0:15050:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89818738b380) 00000020:00000080:3.0:1788592841.526051:0:15050:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788592841.526056:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788592841.526131:0:15050:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89819718b800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788592841.526149:0:15050:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788592841.526156:0:15050:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x27b316f132511b57 00010000:00010000:3.0:1788592841.533869:0:15050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788592841.534612:0:15050:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788592841.540542:0:15050:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788592841.544964:0:15050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788592841.544978:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.544985:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.544987:0:15050:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788592841.544990:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788592841.544993:0:15050:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788592841.544994:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592841.544996:0:15050:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788592841.544998:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788592841.545000:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.545001:0:15050:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788592841.545003:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592841.545006:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.545007:0:15050:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592841.545010:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592841.545012:0:15050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592841.545014:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.545021:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.545022:0:15050:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788592841.545025:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592841.545027:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.545029:0:15050:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788592841.545032:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788592841.545105:0:15050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.545108:0:15050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.545109:0:15050:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788592841.545113:0:15050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788592841.547587:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788592841.547625:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788592841.547693:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b49 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.547704:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bccca200/0x27b316f132511b42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b49 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592841.547714:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819718b800 from 1 10000000:01000000:2.0:1788592841.547716:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592841.547768:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.547777:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.547788:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592841.547814:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592841.547883:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.547924:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.549393:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352448 00000100:00100000:3.0:1788592841.549411:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352448 00000100:00100000:3.0:1788592841.549481:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788592841.549492:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+14:15036:x1875475147352448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788592841.549509:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592841.549527:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b5e expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.549555:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b5e expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.549565:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b5e expref: 15 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.549574:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981c20e8000, rc 0) 00000100:00100000:3.0:1788592841.549645:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352448:12345-0@lo:101:mount.lustre.0 Request processed in 155us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.549652:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788592841.549884:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592841.549904:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.549915:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592841.550578:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788592841.551066:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592841.551320:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788592841.551393:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788592841.551445:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788592841.551452:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788592841.551518:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592841.551572:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.551618:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc5c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592841.551650:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352576 00000100:00100000:2.0:1788592841.551656:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352576 00000100:00100000:2.0:1788592841.551691:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592841.551698:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592841.551910:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352576:12345-0@lo:501:mount.lustre.0 Request processed in 211us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.551918:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788592841.551960:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592841.551990:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592841.552024:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.552036:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592841.552048:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352704 00000100:00100000:2.0:1788592841.552051:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352704 00000100:00100000:2.0:1788592841.552067:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592841.552071:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592841.552185:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352704:12345-0@lo:503:mount.lustre.0 Request processed in 113us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592841.552197:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788592841.552229:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788592841.557538:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592841.557665:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592841.557795:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.557850:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.558309:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352832 00000100:00100000:3.0:1788592841.558319:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352832 00000100:00100000:3.0:1788592841.558396:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788592841.558413:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592841.558643:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352832:12345-0@lo:502:mount.lustre.0 Request processed in 231us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.558651:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788592841.559392:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592841.559691:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788592841.560514:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788592841.560582:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788592841.560615:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788592841.560643:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788592841.560688:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788592841.560736:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788592841.560771:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788592841.560819:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592841.560891:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.560938:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bcc9e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.561878:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147352960 00000100:00100000:3.0:1788592841.561888:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147352960 00000100:00100000:3.0:1788592841.561953:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788592841.561963:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592841.562264:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147352960:12345-0@lo:502:mount.lustre.0 Request processed in 302us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.562272:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788592841.562467:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147352960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592841.562620:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788592841.562635:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788592841.563829:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592841.563840:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.563842:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788592841.563849:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89819718b800 00000020:00000080:3.0:1788592841.563852:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592841.563859:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.563862:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.563863:0:15054:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788592841.563865:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592841.563867:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.563868:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788592841.563871:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff89819718b800 00000020:00000080:3.0:1788592841.563873:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592841.563968:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.563972:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.563973:0:15054:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788592841.563975:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592841.563978:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.563979:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788592841.563990:0:15054:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89819718b800 00000020:00000080:3.0:1788592841.563992:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788592841.564193:0:15054:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592841.564197:0:15054:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592841.564199:0:15054:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788592841.564202:0:15054:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788592841.564571:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788592841.564600:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592841.564946:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.564959:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592841.565013:0:15036:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788592841.565017:0:15036:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89819718b800 10000000:01000000:1.0:1788592841.565021:0:15036:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89819718b800 10000000:01000000:1.0:1788592841.565026:0:15036:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592841.565032:0:15036:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff89819718b800 from 1 10000000:01000000:1.0:1788592841.565035:0:15036:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788592841.565079:0:15036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.565088:0:15036:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.565099:0:15036:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592841.565131:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353088:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788592841.565205:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592841.565263:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592841.565328:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353088 00000100:00100000:0.0:1788592841.565336:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353088 00000100:00100000:0.0:1788592841.565413:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788592841.565424:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+15:15036:x1875475147353088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592841.565437:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592841.565451:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccba00/0x27b316f132511b73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b6c expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.565475:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccba00/0x27b316f132511b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b6c expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.565500:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccba00/0x27b316f132511b73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b6c expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.565510:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccba00, rc 0) 00000100:00100000:0.0:1788592841.565561:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353088:12345-0@lo:101:mount.lustre.0 Request processed in 139us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592841.565569:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788592841.565766:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353088:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592841.565780:0:15036:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b73 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592841.565789:0:15036:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b73 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592841.566416:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788592841.567443:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592841.572496:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788592841.573712:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788592841.574155:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788592841.574244:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788592841.574289:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788592841.574337:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788592841.575440:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788592841.575491:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788592841.575588:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788592841.575648:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788592841.578543:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788592841.578641:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788592841.578674:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788592841.578703:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788592841.578761:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788592841.578793:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788592841.578822:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788592841.580058:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788592841.580103:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788592841.580140:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788592841.580186:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788592841.580216:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788592841.580266:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788592841.580313:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788592841.580363:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788592841.580402:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788592841.580457:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788592841.580489:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788592841.580575:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788592841.580582:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788592841.580697:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592841.581993:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592841.582054:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.582421:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353216 00000100:00100000:3.0:1788592841.582442:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353216 00000100:00100000:3.0:1788592841.582520:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788592841.582532:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592841.582969:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353216:12345-0@lo:501:mount.lustre.0 Request processed in 439us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.582977:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788592841.583086:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353216:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592841.583140:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353344:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592841.583183:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592841.583219:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff89808554ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.583924:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353344 00000100:00100000:3.0:1788592841.583931:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353344 00000100:00100000:3.0:1788592841.583976:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788592841.583983:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592841.584232:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353344:12345-0@lo:503:mount.lustre.0 Request processed in 247us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.584239:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788592841.585438:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353344:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788592841.586077:0:15036:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788592841.586160:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592841.586230:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.586277:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236780 going to sleep for 11 seconds 00000100:00100000:0.0:1788592841.587582:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353472 00000100:00100000:0.0:1788592841.587593:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353472 00000100:00100000:0.0:1788592841.587670:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788592841.587680:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592841.587984:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353472:12345-0@lo:502:mount.lustre.0 Request processed in 305us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592841.587993:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788592841.588065:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592841.588381:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788592841.588432:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788592841.588463:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788592841.588524:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788592841.588560:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788592841.588616:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788592841.588647:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788592841.588677:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788592841.588720:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788592841.588774:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788592841.588809:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788592841.588852:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788592841.588886:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788592841.588917:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788592841.588965:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788592841.589003:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788592841.589037:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788592841.589079:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788592841.589113:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788592841.589160:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788592841.589205:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788592841.589236:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788592841.589265:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788592841.589311:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788592841.589368:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788592841.589410:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788592841.589464:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788592841.589503:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788592841.589542:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788592841.589591:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788592841.589627:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788592841.589663:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788592841.589696:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788592841.589765:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788592841.589808:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788592841.589884:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788592841.589920:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788592841.589949:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788592841.590010:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788592841.590048:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788592841.590098:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592841.590174:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.590220:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353600 00000100:00100000:0.0:1788592841.590227:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353600 00000100:00100000:0.0:1788592841.590271:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788592841.590281:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592841.597224:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592841.601397:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592841.601438:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353600:12345-0@lo:502:mount.lustre.0 Request processed in 10942us (11047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592841.601453:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000040:00080000:1.0:1788592841.601660:0:15036:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788592841.601680:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:2.0:1788592841.604040:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788592841.607418:0:15059:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788592841.607440:0:15059:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8981873899c0) 00000020:00000080:3.0:1788592841.607463:0:15059:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788592841.607538:0:15059:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89819718b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592841.607543:0:15059:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89819718b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788592841.607545:0:15059:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89819718b800 3 00010000:00080000:3.0:1788592841.607588:0:15059:0:(ldlm_lib.c:102:import_set_conn()) imp ffff898188438800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.120@tcp at head 00010000:00010000:3.0:1788592841.611317:0:15059:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788592841.611565:0:15059:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788592841.611628:0:15059:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592841.611642:0:15059:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x27b316f132511b81 00000100:00080000:3.0:1788592841.611654:0:15059:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592841.611660:0:15059:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff898188438800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592841.611698:0:15059:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc786300 x1875475147353728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592841.614053:0:15059:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788592841.614167:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147353728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788592841.614242:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592841.614310:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353728 00000100:00100000:1.0:1788592841.614318:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353728 00000100:00100000:1.0:1788592841.614375:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788592841.614383:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875475147353728:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788592841.614409:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:1.0:1788592841.614451:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x27b316f132511b88 00000004:00100000:1.0:1788592841.614467:0:14356:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788592841.614499:0:14356:0:(import.c:65:import_set_state_nolock()) ffff8981989b2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592841.614543:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875475147353728:12345-0@lo:38:llog_process_th.0 Request processed in 160us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592841.614550:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788592841.614586:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc786300 x1875475147353728/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592841.614597:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788592841.614605:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788592841.614613:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788592841.614618:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788592841.614620:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898188438800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788592841.614625:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3282:1875475147353728:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788592841.618081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592841.618089:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592841.618093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592841.618096:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788592841.620996:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788592841.621438:0:15036:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788592841.621641:0:15036:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788592841.621697:0:15036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b73 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.621710:0:15036:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981988bee00/0x27b316f132511b6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b73 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788592841.621778:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788592841.621781:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592841.621782:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592841.621784:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592841.621785:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592841.621786:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592841.621788:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592841.621790:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592841.621792:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592841.621797:0:15036:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788592841.621800:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788592841.621802:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788592841.621808:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788592841.621809:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788592841.621810:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788592841.621811:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788592841.621812:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788592841.621813:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788592841.621814:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788592841.621856:0:15036:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788592841.621880:0:15036:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788592841.621960:0:15036:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592841.622009:0:15036:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236780 going to sleep for 11 seconds 00000100:00100000:1.0:1788592841.622230:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353856 00000100:00100000:1.0:1788592841.622240:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353856 00000100:00100000:1.0:1788592841.622299:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788592841.622309:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788592841.622337:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788592841.622395:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788592841.650265:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788592841.650310:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788592841.655650:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15036:x1875475147353856:12345-0@lo:253:mount.lustre.0 Request processed in 33331us (33679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592841.655667:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788592841.655937:0:15036:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15036:1875475147353856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788592841.655955:0:15036:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788592841.655976:0:15036:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788592841.655978:0:15036:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788592841.655979:0:15036:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788592841.655981:0:15036:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788592841.655982:0:15036:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788592841.655984:0:15036:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788592841.655985:0:15036:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788592841.655987:0:15036:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788592841.655988:0:15036:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788592841.656006:0:15036:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788592841.658486:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788592841.658496:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788592841.658526:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.658545:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511af5 expref: 15 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.658553:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.658613:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 15 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592841.658631:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 15 pid: 14349 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592841.658648:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147353984:0@lo:104: 00000100:00100000:2.0:1788592841.658713:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592841.658785:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184b606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592841.658966:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147353984 00000100:00100000:3.0:1788592841.658976:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147353984 00000100:00100000:3.0:1788592841.659035:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592841.659045:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147353984:12345-0@lo:104: 00010000:00010000:3.0:1788592841.659059:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659249:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592841.659255:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147353984:12345-0@lo:104: Request processed in 212us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.659264:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788592841.659288:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592841.659295:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659315:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592841.659320:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659330:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592841.659338:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592841.659345:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592841.659399:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659406:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592841.659423:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659430:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511af5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511afc expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659451:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592841.659453:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592841.659455:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592841.659480:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147354112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592841.659512:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592841.659578:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354112 00000100:00100000:3.0:1788592841.659582:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354112 00010000:00010000:3.0:1788592841.659615:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 16 pid: 14349 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592841.659645:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592841.659653:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147354112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592841.659664:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592841.659670:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 16 pid: 14349 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659681:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 16 pid: 14349 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659699:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.659707:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788592841.660033:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001535897s 00010000:00010000:3.0:1788592841.660040:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660047:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660054:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660061:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660067:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592841.660078:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660085:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660094:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592841.660105:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592841.660146:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147354112:12345-0@lo:103:ldlm_bl.0 Request processed in 495us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592841.660153:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788592841.660253:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccae00/0x27b316f132511afc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511af5 expref: 15 pid: 14349 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592841.660264:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147353984:0@lo:104: 00010000:00010000:0.0:1788592841.660284:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.660293:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.660299:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592841.660305:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981885f4800/0x27b316f132511b8f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592841.660379:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147354112:0@lo:103:ldlm_bl.0 00080000:10000000:2.0:1788592841.666300:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592841.666568:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788592841.666706:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592841.667043:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788592841.667186:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592841.667707:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788592841.668477:0:15036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788592841.746141:0:15036:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788592841.746150:0:15036:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788592841.746198:0:15036:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788592841.746259:0:15036:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788592841.746280:0:15036:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788592841.746311:0:15036:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788592842.623001:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788592842.814435:0:14352:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788592842.814443:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8981c0d8e000 from 7 10000000:01000000:3.0:1788592842.814449:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788592842.814499:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.814510:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.814521:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592842.814561:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147354240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592842.814637:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592842.814696:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592842.814853:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354240 00000100:00100000:0.0:1788592842.814861:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354240 00000100:00100000:0.0:1788592842.814927:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788592842.814939:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+15:14352:x1875475147354240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592842.814952:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592842.814965:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511b96 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.814989:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511b96 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.815000:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b96 expref: 16 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592842.815010:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb800, rc 0) 00000100:00100000:0.0:1788592842.815062:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:14352:x1875475147354240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592842.815068:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788592842.815217:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147354240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592842.815242:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.815251:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592842.815301:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147354368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788592842.815333:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592842.815388:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788592842.815463:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354368 00000100:00100000:0.0:1788592842.815468:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354368 00000100:00100000:0.0:1788592842.815538:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788592842.815545:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:14352:x1875475147354368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788592842.815571:0:14347:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788592842.815591:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788592842.815594:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788592842.815677:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:14352:x1875475147354368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592842.815689:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788592842.817422:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147354368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788592842.817500:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788592842.817511:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592842.817521:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592843.651496:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592844.675397:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592845.694898:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592846.718864:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788592847.112048:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592847.112055:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788592847.112058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788592847.112061:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788592847.112127:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147354496:0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112210:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592847.112262:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592847.112269:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147354624:0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112312:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592847.112341:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147354752:0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112408:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592847.112444:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354496 00000100:00100000:3.0:1788592847.112453:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354496 00000100:00100000:3.0:1788592847.112501:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788592847.112511:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3285:x1875475147354496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112559:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3285:x1875475147354496:12345-0@lo:400:kworker.0 Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592847.112566:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788592847.112606:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354624 00000100:00100000:3.0:1788592847.112610:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354624 00000100:00100000:3.0:1788592847.112643:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354752 00000100:00100000:3.0:1788592847.112646:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354752 00000100:00100000:3.0:1788592847.112744:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592847.112752:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147354624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112784:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147354624:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592847.112791:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788592847.112802:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592847.112807:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147354752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112834:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147354752:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592847.112840:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788592847.112882:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc785f80 x1875475147354624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592847.112908:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc785f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147354624:0@lo:400:kworker.0 00000100:00100000:3.0:1788592847.112919:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147354496:0@lo:400:kworker.0 00010000:00080000:3.0:1788592847.112953:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc784e00 x1875475147354752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592847.112961:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147354752:0@lo:400:kworker.0 00000100:00080000:0.0:1788592847.113830:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592847.746194:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788592848.319123:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592848.771743:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788592848.921414:0:15404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788592849.791564:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592850.815632:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592851.839262:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592836/real 1788592836] req@ffff8981bc784380 x1875475147350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592851 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.839294:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8981bc784380 x1875475147350400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592851 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.839304:0:3282:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788592836/real 1788592836] req@ffff8981bc786d80 x1875475147350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592851 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.839313:0:3282:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8981bc786d80 x1875475147350528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788592851 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788592851.839332:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89808418e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592851.839368:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788592851.839373:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147350400:0@lo:8:kworker.0 00000100:00080000:3.0:1788592851.839378:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788592851.839383:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788592851.839394:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147350528:0@lo:8:kworker.0 00010000:00010000:2.0:1788592851.839491:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592851.840467:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592851.840473:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788592851.840476:0:8:0:(import.c:65:import_set_state_nolock()) ffff89808418e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592851.840483:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1788592851.840489:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788592851.840496:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89808418e800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592851.840516:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087920700 x1875475147355008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788592851.840547:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592851.840551:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592851.840553:0:8:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592851.840557:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1788592851.840559:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788592851.840563:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592851.840575:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087921880 x1875475147355136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592851.842854:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147355008:0@lo:8:kworker.0 00000100:00100000:2.0:1788592851.842942:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592851.843004:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147355136:0@lo:8:kworker.0 00000100:00100000:2.0:1788592851.843050:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592851.843107:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355008 00000100:00100000:2.0:1788592851.843121:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355008 00000100:00100000:2.0:1788592851.843168:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355136 00000100:00100000:2.0:1788592851.843171:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355136 00000100:00100000:2.0:1788592851.843186:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592851.843194:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147355008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788592851.843225:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1788592851.843258:0:15038:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132511ba4 00002000:00100000:2.0:1788592851.843272:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89819840d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788592851.843276:0:15038:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788592851.843279:0:15038:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788592851.843671:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788592851.843704:0:15038:0:(import.c:65:import_set_state_nolock()) ffff898198409000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592851.843764:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875475147355008:12345-0@lo:8:kworker.0 Request processed in 569us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592851.843772:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788592851.843793:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788592851.843797:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147355136:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788592851.843808:0:15038:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788592851.843833:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147355136:12345-0@lo:8:kworker.0 Request processed in 34us (782us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788592851.843839:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788592851.843880:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087920700 x1875475147355008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592851.843890:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592851.843899:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788592851.843908:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592851.843921:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788592851.843924:0:3282:0:(import.c:65:import_set_state_nolock()) ffff89808418e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592851.843951:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592851.843957:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147355008:0@lo:8:kworker.0 00000100:00080000:2.0:1788592851.843972:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592851.843976:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592851.843979:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147355136:0@lo:8:kworker.0 00000004:00080000:2.0:1788592851.844036:0:14377:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788592851.844054:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875475147355648:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788592851.844081:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592851.844101:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187240300 going to sleep for 11 seconds 00000100:00100000:2.0:1788592851.844113:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355648 00000100:00100000:2.0:1788592851.844117:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355648 00000100:00100000:2.0:1788592851.844156:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592851.844162:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1875475147355648:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788592851.845792:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147354880:0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.845862:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592851.845921:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788592851.845928:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147355520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788592851.845964:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592851.845998:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147355264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846024:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592851.846044:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592851.846050:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147355392:0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846069:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592851.846104:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147354880 00000100:00100000:3.0:1788592851.846112:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147354880 00000100:00100000:3.0:1788592851.846170:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592851.846179:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147354880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846225:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147354880:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592851.846233:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788592851.846273:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355264 00000100:00100000:3.0:1788592851.846276:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355264 00000100:00100000:3.0:1788592851.846298:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355392 00000100:00100000:3.0:1788592851.846300:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355392 00000100:00100000:3.0:1788592851.846318:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592851.846323:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147355264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846390:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147355264:12345-0@lo:400:kworker.0 Request processed in 66us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592851.846411:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592851.846424:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592851.846429:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147355392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846460:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147355392:12345-0@lo:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592851.846465:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788592851.846509:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087920380 x1875475147355392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.846523:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147355392:0@lo:400:kworker.0 00010000:00080000:3.0:1788592851.846545:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087923b80 x1875475147355264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.846553:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147355264:0@lo:400:kworker.0 00000100:00100000:3.0:1788592851.846580:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147354880:0@lo:400:kworker.0 00000004:00080000:3.0:1788592851.846878:0:14376:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788592851.847165:0:14376:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 426087814295ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788592851.847561:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355520 00000100:00100000:3.0:1788592851.847570:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355520 00000100:00100000:3.0:1788592851.847604:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592851.847612:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147355520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788592851.847644:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592851.847707:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3284:x1875475147355520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592851.847715:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788592851.847755:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc5d1f80 x1875475147355520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592851.847782:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147355520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592851.849993:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592851.850004:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788592851.864871:0:15038:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788592851.864882:0:15038:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788592851.864888:0:15038:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788592851.876398:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.876417:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876443:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.876449:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.876458:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876498:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876512:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876521:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876567:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.876590:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.876597:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876606:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.876612:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876624:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876643:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876652:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.876681:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.876683:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.876685:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.880116:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.881464:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.881490:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.881495:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.881504:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.881523:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.881546:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882033:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882065:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.882085:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.882092:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882118:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.882124:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882288:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882310:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882317:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c194fbd/0x27b316f132511bb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.882492:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.882495:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.882497:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.890844:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.890866:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.890890:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.890896:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.890905:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.890923:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.890949:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.890959:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.890997:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592851.891917:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.891930:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.891944:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.891951:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.891962:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.891991:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.892000:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac6e6130/0x27b316f132511bb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.892025:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.892027:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.892029:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.897157:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.897183:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897204:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.897209:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.897217:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897233:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897246:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897256:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897301:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.897326:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.897334:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897342:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.897390:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897403:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897423:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897432:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc2d5f88/0x27b316f132511bc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.897454:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.897456:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.897459:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.897984:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.897992:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898001:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.898012:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.898017:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898028:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898037:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898046:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898072:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.898084:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.898089:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898096:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4a00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.898100:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898109:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898121:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898141:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000652e09bd/0x27b316f132511bc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898158:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.898160:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.898162:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.898665:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.898671:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898680:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.898683:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.898687:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898696:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898705:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898712:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898728:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.898736:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.898745:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898753:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4e00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.898757:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898765:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898777:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898784:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e8adf2/0x27b316f132511bce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.898799:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.898800:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.898802:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.899183:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.899190:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.899198:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.899201:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.899205:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.899225:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.899234:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.899241:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.901925:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.901965:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.901977:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.901993:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.901999:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.902012:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.902039:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.902047:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d4046ac/0x27b316f132511bd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.902098:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.902100:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.902102:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.902993:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.903004:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903018:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.903023:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.903031:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903044:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903054:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903063:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903086:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.903099:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.903104:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903126:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.903129:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903138:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903151:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903160:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000633014fb/0x27b316f132511bdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.903176:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.903178:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.903180:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.904246:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.904260:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904276:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.904279:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.904284:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904295:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904312:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904319:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904340:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592851.904385:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.904391:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904398:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.904403:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904412:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904425:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904432:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd8c3a9b/0x27b316f132511be3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.904450:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.904457:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.904459:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592851.907036:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.907052:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.907071:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.907076:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.907083:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.907098:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.907111:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.907118:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.907146:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592851.908177:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592851.908188:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908201:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=426s v=(0 0) 00010000:00010000:2.0:1788592851.908205:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592851.908210:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908229:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908239:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908246:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908272:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592851.908291:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592851.908298:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908306:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.908311:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908322:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908340:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908377:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b004115/0x27b316f132511bea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908408:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.908412:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908419:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.908422:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908430:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908440:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908448:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2f20a76/0x27b316f132511bf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.908459:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.908461:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.908462:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.908693:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.911150:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.911289:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.911312:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.911318:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.911328:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.911446:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.911460:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.911469:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.911547:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.912381:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.912392:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.912405:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.912417:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.912422:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.912435:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.912443:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.912450:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913066:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592851.913079:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913090:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.913105:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913117:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913141:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913150:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996fbf81/0x27b316f132511bf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913674:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.913681:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913689:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.913692:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913700:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913712:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.913720:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.913731:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.913734:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.913902:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.913912:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511bff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592851.914682:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.914692:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.914708:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.914713:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.914720:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.914734:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.914750:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.914757:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.915722:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.915738:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.915749:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.915755:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.915766:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.915787:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.915796:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.915798:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.915800:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.915892:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.915900:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788592851.916786:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.916797:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.916812:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.916816:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.916824:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.916838:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.916848:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.916868:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.917501:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.917512:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.917522:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fa00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.917540:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.917552:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.918036:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.918050:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.918055:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.918061:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.918181:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.918189:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.922523:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.925152:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.925296:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.925321:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.925327:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.925337:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.925396:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.925410:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.925419:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.925450:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.926080:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.926088:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926100:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.926104:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.926110:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926121:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926131:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926139:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926326:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788592851.926915:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.926923:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926935:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.926944:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.926949:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926961:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926970:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926977:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.926987:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788592851.927310:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788592851.927322:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927345:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.927367:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927378:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927400:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927408:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ca59004/0x27b316f132511c14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927436:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592851.927440:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927446:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.927449:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927456:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927464:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927478:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000827a04ab/0x27b316f132511c1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927491:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.927494:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927501:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.927504:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927512:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927521:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927541:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004437cf82/0x27b316f132511c22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.927554:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.927556:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.927558:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.928012:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.928019:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.928031:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.928035:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.928041:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.928053:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.928063:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.928080:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.928100:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592851.928267:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.928273:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.928288:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.928292:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.928301:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.928313:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.928321:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff8c5c6c/0x27b316f132511c29 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.928341:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.928343:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.928344:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.928823:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.929243:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.929253:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.929265:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.929269:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.929274:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.929286:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.929296:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.929304:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.929839:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.930499:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.930508:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.930627:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.930632:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.930638:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.930651:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.930662:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.930670:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932844:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592851.932865:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932882:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.932888:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932902:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932948:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932957:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ccc6736/0x27b316f132511c30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.932988:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.932993:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.933000:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.933003:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.933011:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.933021:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.933028:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.933030:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.933032:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.934582:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.934599:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.935768:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.937332:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.937369:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.937392:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.937397:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.937406:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.937436:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.937450:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.937459:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.937480:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.942145:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.943382:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.943410:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.943416:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.943425:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.943446:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.943459:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.943484:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.943510:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592851.943822:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592851.943832:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943841:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fa00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.943847:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943858:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943878:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943887:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004defe1ea/0x27b316f132511c3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943933:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592851.943937:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943944:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592851.943947:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943955:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943966:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943974:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbf17738/0x27b316f132511c45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592851.943991:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.943993:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592851.943995:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.944393:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.946077:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.946090:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.946109:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.946114:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.946121:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.946152:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.947494:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.947513:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.947598:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.951152:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.951189:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.951220:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.951227:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.951235:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.951255:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.951270:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.951279:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592851.951417:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788592851.951677:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592851.951688:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951705:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.951711:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951724:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951746:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951755:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072344c62/0x27b316f132511c4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951773:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.951776:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951783:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.951786:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951794:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951804:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.951819:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.951821:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.951823:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.952555:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.952565:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fe5f754/0x27b316f132511c53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.953311:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592851.953686:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.953697:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.953715:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.953721:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.953729:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.953761:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.953772:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.953782:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.953844:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592851.954491:0:15038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592851.954498:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.954510:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=426s v=(0 0) 00010000:00010000:3.0:1788592851.954514:0:15038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592851.954518:0:15038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.954541:0:15038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.954550:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592851.954570:0:15038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954794:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592851.954803:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954812:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.954817:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954827:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954847:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954856:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8713147/0x27b316f132511c5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954880:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592851.954884:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954890:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592851.954903:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954911:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954921:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592851.954930:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.954931:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592851.954933:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592851.955000:0:15038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592851.955006:0:15038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f416548f/0x27b316f132511c61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788592851.955669:0:15038:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1788592851.955837:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14377:x1875475147355648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111670us (111750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592851.955855:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788592851.955944:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592851.956005:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875475147355648:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788592851.956026:0:14377:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788592851.956084:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875475147355776:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788592851.956234:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592851.956335:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff898187240300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592851.957281:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355776 00000100:00100000:3.0:1788592851.957294:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355776 00000100:00100000:3.0:1788592851.957381:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788592851.957393:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14377:x1875475147355776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788592851.957461:0:15039:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1788592851.969491:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14377:x1875475147355776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12089us (13353us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788592851.969508:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592851.969905:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14377:1875475147355776:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788592851.969931:0:14377:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:0.0:1788592852.347990:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788592852.348026:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788592852.862584:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592853.890684:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592854.920297:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592855.934527:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592856.961136:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788592857.346071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592857.346080:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592857.346084:0:8:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592857.346094:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:1.0:1788592857.346101:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788592857.346110:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592857.346138:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087922d80 x1875475147356160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788592857.348749:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147356160:0@lo:8:kworker.0 00000100:00100000:2.0:1788592857.348855:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.349645:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147355904:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.349703:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.349741:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788592857.349748:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147356416:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.349783:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.349818:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147355904 00000100:00100000:2.0:1788592857.349829:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147355904 00000100:00100000:2.0:1788592857.349899:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592857.349909:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147355904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.349973:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147355904:12345-0@lo:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.349982:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788592857.350040:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356416 00000100:00100000:2.0:1788592857.350044:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356416 00000100:00100000:2.0:1788592857.350083:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592857.350089:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147356416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.350121:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1875475147356416:12345-0@lo:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.350128:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788592857.350176:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087921f80 x1875475147356416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592857.350216:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3284:1875475147356416:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.350229:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147355904:0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.350977:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147356032:0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.351044:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592857.351080:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788592857.351088:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147356288:0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.351134:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592857.351169:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356160 00000100:00100000:3.0:1788592857.351176:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356160 00000100:00100000:3.0:1788592857.351207:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356032 00000100:00100000:3.0:1788592857.351210:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356032 00000100:00100000:3.0:1788592857.351257:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592857.351265:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147356032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.351312:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147356032:12345-0@lo:400:kworker.0 Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.351319:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592857.351335:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592857.351340:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147356160:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788592857.351385:0:15038:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788592857.353919:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788592857.353932:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592857.356311:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592857.356345:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592857.356462:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592857.356526:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356544 00000100:00100000:0.0:1788592857.356535:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356544 00000100:00100000:0.0:1788592857.356590:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592857.356600:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147356544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592857.356645:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592857.356712:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147356544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.356719:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788592857.356777:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788592857.356806:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147356544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592857.357694:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356288 00000100:00100000:0.0:1788592857.357706:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356288 00000100:00100000:0.0:1788592857.357746:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788592857.357754:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147356288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592857.357820:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1875475147356288:12345-0@lo:400:kworker.0 Request processed in 67us (6685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.357827:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788592857.387504:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087923800 x1875475147356288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592857.387532:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3285:1875475147356288:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.387556:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147356032:0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.398855:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3282:x1875475147356160:12345-0@lo:8:kworker.0 Request processed in 47499us (49985us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788592857.398874:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788592857.399148:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592857.399155:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788592857.399160:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147356160:0@lo:8:kworker.0 00000020:01000004:1.0:1788592857.620270:0:15755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788592857.620275:0:15755:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788592857.620443:0:15755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8981989b1000 00000020:01000004:1.0:1788592857.620463:0:15755:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788592857.620480:0:15755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788592857.620519:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8981842f0000) 00000020:00000080:1.0:1788592857.620542:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788592857.646704:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788592857.647792:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788592857.650668:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788592857.650937:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788592857.651254:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788592857.651734:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 507: rc = 0 00100000:10000000:0.0:1788592857.651898:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 507: rc = 0 00100000:10000000:0.0:1788592857.652000:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 507: rc = 0 00100000:10000000:0.0:1788592857.652627:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 562: rc = 0 00100000:10000000:0.0:1788592857.652976:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 562: rc = 0 00100000:10000000:0.0:1788592857.653402:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 562: rc = 0 00100000:10000000:0.0:1788592857.653673:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 562: rc = 0 00100000:10000000:0.0:1788592857.653972:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 562: rc = 0 00100000:10000000:0.0:1788592857.654311:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 562: rc = 0 00000020:00000080:1.0:1788592857.655406:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788592857.655435:0:15755:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788592857.655449:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27b316f132511c6f 00000020:01000004:1.0:1788592857.655460:0:15755:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788592857.655488:0:15755:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788592857.655492:0:15755:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788592857.655500:0:15755:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788592857.655525:0:15755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788592857.655529:0:15755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788592857.685428:0:15755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788592857.685479:0:15755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788592857.685485:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788592857.685488:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.685489:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.685490:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.685492:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.685493:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.685495:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.685497:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.685499:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592857.685503:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788592857.685505:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592857.685507:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.685508:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.685509:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.685510:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.685511:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.685513:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.685520:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.685520:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788592857.685558:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788592857.685587:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356672:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788592857.685699:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.685772:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671900 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.685906:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356672 00000100:00100000:3.0:1788592857.685917:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356672 00000100:00100000:3.0:1788592857.685983:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788592857.685993:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15755:x1875475147356672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788592857.686043:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788592857.686047:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788592857.686052:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788592857.698037:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:15755:x1875475147356672:12345-0@lo:253:mount.lustre.0 Request processed in 12023us (12316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.698056:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788592857.698320:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788592857.698341:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788592857.698345:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592857.698386:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.698388:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.698390:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.698392:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.698394:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.698395:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.698397:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.698399:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788592857.698439:0:15755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8981989b1000 from lustre-OST0001 10000000:01000000:2.0:1788592857.698470:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788592857.698474:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788592857.698483:0:15755:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff898086383380 local copy 00010000:00010000:2.0:1788592857.698498:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592857.698790:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592857.698837:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.698876:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.698954:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356800 00000100:00100000:0.0:1788592857.698961:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356800 00000100:00100000:0.0:1788592857.699011:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788592857.699032:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147356800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592857.699330:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147356800:12345-0@lo:501:mount.lustre.0 Request processed in 300us (492us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788592857.699338:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788592857.699488:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356800:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788592857.699509:0:15755:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788592857.699688:0:15755:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788592857.699698:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.699710:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f5a00/0x27b316f132511a1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511a23 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592857.699736:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8981989b1000 10000000:01000000:1.0:1788592857.699742:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788592857.699749:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788592857.699752:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788592857.699757:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788592857.699761:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788592857.699794:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.699802:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.699812:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592857.699828:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788592857.699862:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.699898:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.700043:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147356928 00000100:00100000:0.0:1788592857.700049:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147356928 00000100:00100000:0.0:1788592857.700075:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788592857.700082:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147356928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592857.700094:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592857.700108:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bccca800/0x27b316f132511c7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511c76 expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.700134:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bccca800/0x27b316f132511c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511c76 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.700146:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bccca800/0x27b316f132511c7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511c76 expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.700156:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca800, rc 0) 00000100:00100000:0.0:1788592857.700196:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147356928:12345-0@lo:101:mount.lustre.0 Request processed in 113us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.700202:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788592857.700521:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147356928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788592857.700540:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c7d expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.700564:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511c7d expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788592857.701390:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788592857.703617:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788592857.703939:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788592857.703986:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788592857.704020:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788592857.704069:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788592857.704107:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788592857.704140:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788592857.704235:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788592857.704243:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788592857.704559:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592857.704650:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.704708:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.704787:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357056 00000100:00100000:0.0:1788592857.704797:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357056 00000100:00100000:0.0:1788592857.704860:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788592857.704871:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788592857.705490:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357056:12345-0@lo:501:mount.lustre.0 Request processed in 620us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.705500:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788592857.705713:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592857.705757:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788592857.705804:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.705845:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592857.705933:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357184 00000100:00100000:2.0:1788592857.705940:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357184 00000100:00100000:2.0:1788592857.705981:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788592857.705990:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592857.706640:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357184:12345-0@lo:503:mount.lustre.0 Request processed in 648us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.706656:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788592857.707789:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357184:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788592857.708707:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788592857.710166:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592857.710299:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.710483:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818974fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.714137:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357312 00000100:00100000:0.0:1788592857.714161:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357312 00000100:00100000:0.0:1788592857.714322:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788592857.714335:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788592857.714802:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357312:12345-0@lo:502:mount.lustre.0 Request processed in 468us (4501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.714812:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788592857.714974:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592857.715323:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788592857.715437:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788592857.715487:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788592857.715538:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788592857.715575:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788592857.715612:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788592857.715683:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788592857.715722:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788592857.715778:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788592857.715833:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.715898:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.717703:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.717815:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357440 00000100:00100000:3.0:1788592857.717845:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357440 00000100:00100000:3.0:1788592857.717899:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788592857.717909:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592857.718291:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357440:12345-0@lo:502:mount.lustre.0 Request processed in 384us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.718299:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788592857.718465:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592857.718608:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788592857.718626:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788592857.720280:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788592857.720294:0:15757:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788592857.720302:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592857.720306:0:15757:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788592857.720312:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788592857.720332:0:15757:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff898184318000) 00000020:00000080:2.0:1788592857.720390:0:15757:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788592857.720399:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788592857.720495:0:15757:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8981989b1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788592857.720503:0:15757:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788592857.720512:0:15757:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x27b316f132511c8b 00010000:00010000:3.0:1788592857.724859:0:15757:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788592857.725678:0:15757:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788592857.728121:0:15757:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788592857.730094:0:15757:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788592857.730110:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592857.730118:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592857.730121:0:15757:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788592857.730124:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592857.730130:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592857.730132:0:15757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788592857.730135:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788592857.730137:0:15757:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788592857.730139:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592857.730142:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592857.730143:0:15757:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788592857.730146:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788592857.730148:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592857.730149:0:15757:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788592857.730153:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788592857.730231:0:15757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788592857.730235:0:15757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788592857.730236:0:15757:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788592857.730241:0:15757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788592857.730511:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788592857.730555:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788592857.730581:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c7d expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.730597:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981988be400/0x27b316f132511c76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c7d expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592857.730607:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8981989b1000 from 1 10000000:01000000:2.0:1788592857.730609:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788592857.730660:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.730669:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.730682:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592857.730713:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357568:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592857.730800:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.730895:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.737508:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357568 00000100:00100000:0.0:1788592857.737528:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357568 00000100:00100000:0.0:1788592857.737648:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788592857.737661:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+17:15755:x1875475147357568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788592857.737684:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592857.737712:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511c92 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.737749:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511c92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.737763:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511c92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.737774:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592857.737876:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357568:12345-0@lo:101:mount.lustre.0 Request processed in 217us (7075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.737906:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788592857.740117:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592857.740159:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.740175:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592857.743845:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788592857.746690:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592857.747431:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788592857.747499:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788592857.747576:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788592857.747586:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788592857.747741:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592857.747839:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.747891:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592857.748122:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357696 00000100:00100000:1.0:1788592857.748145:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357696 00000100:00100000:1.0:1788592857.748217:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788592857.748229:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788592857.748591:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357696:12345-0@lo:501:mount.lustre.0 Request processed in 363us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592857.748600:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788592857.750206:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592857.750279:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357824:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592857.750385:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.750435:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788592857.750541:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357824 00000100:00100000:0.0:1788592857.750549:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357824 00000100:00100000:0.0:1788592857.750603:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788592857.750614:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788592857.751108:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357824:12345-0@lo:503:mount.lustre.0 Request processed in 494us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.751117:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788592857.751326:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357824:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788592857.754005:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592857.754148:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.754254:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.754308:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788592857.755270:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147357952 00000100:00100000:1.0:1788592857.755284:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147357952 00000100:00100000:1.0:1788592857.755372:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788592857.755385:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357952:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788592857.755767:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147357952:12345-0@lo:502:mount.lustre.0 Request processed in 384us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592857.755776:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788592857.756148:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147357952:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592857.756563:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788592857.756637:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788592857.756691:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788592857.756731:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788592857.756769:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788592857.756821:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788592857.756862:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788592857.756899:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788592857.756949:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.757265:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.757404:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.757630:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358080 00000100:00100000:3.0:1788592857.757638:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358080 00000100:00100000:3.0:1788592857.757692:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788592857.757709:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147358080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788592857.757953:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147358080:12345-0@lo:502:mount.lustre.0 Request processed in 245us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.757961:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788592857.758181:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592857.758394:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788592857.758412:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788592857.760755:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592857.760773:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592857.760776:0:15761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788592857.760784:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8981989b1000 00000020:00000080:1.0:1788592857.760787:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788592857.760797:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788592857.760799:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592857.760801:0:15761:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788592857.760803:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788592857.760806:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788592857.760807:0:15761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788592857.760810:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8981989b1000 00000020:00000080:1.0:1788592857.760812:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788592857.760963:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592857.761043:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592857.761046:0:15761:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788592857.761051:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788592857.761055:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592857.761056:0:15761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788592857.761060:0:15761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8981989b1000 00000020:00000080:2.0:1788592857.761063:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788592857.766767:0:15761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788592857.766797:0:15761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788592857.766800:0:15761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788592857.766807:0:15761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788592857.767567:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788592857.767615:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788592857.767641:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.767656:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788592857.767739:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788592857.767743:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8981989b1000 10000000:01000000:2.0:1788592857.767746:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8981989b1000 10000000:01000000:2.0:1788592857.767751:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788592857.767758:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8981989b1000 from 1 10000000:01000000:2.0:1788592857.767762:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788592857.767816:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.767839:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.767854:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592857.767897:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788592857.767993:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.768046:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358208 00000100:00100000:2.0:1788592857.768056:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358208 00000100:00100000:2.0:1788592857.768583:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592857.768599:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147358208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592857.768618:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592857.768638:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5400/0x27b316f132511ca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511ca0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.768670:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5400/0x27b316f132511ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511ca0 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.768683:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5400/0x27b316f132511ca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511ca0 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.768692:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5400, rc 0) 00000100:00100000:2.0:1788592857.768760:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358208:12345-0@lo:101:mount.lustre.0 Request processed in 164us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.768769:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788592857.768949:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592857.768990:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788592857.769013:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ca7 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.769026:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511ca7 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788592857.770708:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788592857.771600:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788592857.772006:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788592857.772126:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788592857.772326:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788592857.772543:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788592857.772607:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788592857.772686:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788592857.772741:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788592857.772888:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788592857.772967:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788592857.773020:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788592857.773071:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788592857.773127:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788592857.773507:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788592857.773556:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788592857.773609:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788592857.773646:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788592857.773679:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788592857.773731:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788592857.773771:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788592857.773893:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788592857.773946:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788592857.773989:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788592857.774026:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788592857.774551:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788592857.774597:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788592857.774630:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788592857.774699:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788592857.774740:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788592857.774774:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788592857.774853:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788592857.774891:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788592857.774923:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788592857.774955:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788592857.775004:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788592857.775044:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788592857.775111:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788592857.775168:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788592857.775321:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788592857.775333:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788592857.775776:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592857.775927:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.775980:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.779262:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358336 00000100:00100000:3.0:1788592857.779285:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358336 00000100:00100000:3.0:1788592857.779382:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788592857.779395:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788592857.779812:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358336:12345-0@lo:501:mount.lustre.0 Request processed in 418us (3884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.779820:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788592857.780052:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788592857.780132:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788592857.780207:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.780254:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.782174:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358464 00000100:00100000:3.0:1788592857.782193:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358464 00000100:00100000:3.0:1788592857.782274:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788592857.782285:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358464:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788592857.784770:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358464:12345-0@lo:503:mount.lustre.0 Request processed in 2472us (4548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.784862:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788592857.785954:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788592857.786942:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788592857.787765:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.787878:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.788262:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898188671d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788592857.788403:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358592 00000100:00100000:3.0:1788592857.788426:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358592 00000100:00100000:3.0:1788592857.788843:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788592857.788865:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.789695:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358592:12345-0@lo:502:mount.lustre.0 Request processed in 830us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.789708:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788592857.789787:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788592857.790266:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788592857.790380:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788592857.790443:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788592857.790572:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788592857.790637:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788592857.790692:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788592857.790747:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788592857.791057:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788592857.791121:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788592857.791156:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788592857.791183:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788592857.791769:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788592857.793119:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788592857.793156:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788592857.794166:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788592857.794317:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788592857.794375:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788592857.794462:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788592857.794500:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788592857.794531:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788592857.794574:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788592857.794603:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788592857.794629:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788592857.794671:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788592857.794700:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788592857.794728:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788592857.796517:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788592857.796735:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788592857.796782:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788592857.796888:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788592857.796931:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788592857.796967:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788592857.797025:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788592857.797078:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788592857.797113:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788592857.797157:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788592857.797191:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788592857.797226:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788592857.797274:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788592857.797309:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788592857.797433:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.797540:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.797596:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358720 00000100:00100000:2.0:1788592857.797605:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358720 00000100:00100000:2.0:1788592857.797666:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788592857.797676:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788592857.797944:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147358720:12345-0@lo:502:mount.lustre.0 Request processed in 269us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.797952:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788592857.798016:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff898193a80780 going to sleep for 11 seconds 00000100:00100000:2.0:1788592857.798041:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147358720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788592857.798118:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788592857.798130:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788592857.802638:0:15766:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788592857.802660:0:15766:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8981842f19c0) 00000020:00000080:1.0:1788592857.802692:0:15766:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788592857.804088:0:15766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8981989b1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788592857.804099:0:15766:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8981989b1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788592857.804103:0:15766:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8981989b1000 3 00010000:00080000:1.0:1788592857.804152:0:15766:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8981bccd5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.120@tcp at head 00010000:00010000:1.0:1788592857.806007:0:15766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788592857.814152:0:15766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788592857.814212:0:15766:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788592857.814229:0:15766:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x27b316f132511cb5 00000100:00080000:3.0:1788592857.814244:0:15766:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788592857.814260:0:15766:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8981bccd5000 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:3.0:1788592857.814946:0:15766:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bc787480 x1875475147358848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788592857.814983:0:15766:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788592857.815094:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788592857.815100:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788592857.815109:0:36:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788592857.815114:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 431 00000100:00080000:1.0:1788592857.815118:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788592857.815124:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:1.0:1788592857.815140:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff898087922d80 x1875475147359104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788592857.815193:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147359232:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.815195:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147358848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788592857.815664:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147358976:0@lo:400:kworker.0 00000100:00100000:1.0:1788592857.816311:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.816403:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147359360:0@lo:400:kworker.0 00000100:00100000:1.0:1788592857.816452:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592857.816607:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359232 00000100:00100000:0.0:1788592857.816617:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359232 00000100:00100000:0.0:1788592857.816861:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359360 00000100:00100000:0.0:1788592857.816869:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359360 00000100:00100000:0.0:1788592857.816892:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592857.816902:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147359232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592857.816976:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1875475147359232:12345-0@lo:400:kworker.0 Request processed in 74us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.816983:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592857.817002:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788592857.817008:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147359360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592857.817041:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147359360:12345-0@lo:400:kworker.0 Request processed in 33us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592857.817047:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788592857.817180:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.817223:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147359104:0@lo:8:kworker.0 00000100:00100000:2.0:1788592857.817254:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.817457:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359104 00000100:00100000:2.0:1788592857.817461:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359104 00000100:00100000:2.0:1788592857.817484:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592857.817489:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875475147359104:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788592857.817546:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3282:x1875475147359104:12345-0@lo:8:kworker.0 Request processed in 56us (291us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788592857.817553:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592857.817583:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358848 00000100:00100000:2.0:1788592857.817586:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358848 00000100:00100000:2.0:1788592857.817597:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592857.817602:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3282:x1875475147358848:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788592857.817620:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:2.0:1788592857.817668:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x27b316f132511cbc 00000004:00100000:2.0:1788592857.817688:0:14356:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788592857.817727:0:14356:0:(import.c:65:import_set_state_nolock()) ffff89808584c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592857.817763:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875475147358848:12345-0@lo:38:llog_process_th.0 Request processed in 160us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.817769:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788592857.817810:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8981bc787480 x1875475147358848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788592867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592857.817820:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592857.817830:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788592857.817845:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788592857.817850:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788592857.817852:0:3282:0:(import.c:65:import_set_state_nolock()) ffff8981bccd5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788592857.817858:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3282:1875475147358848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788592857.817870:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788592857.817874:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788592857.817877:0:3282:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788592857.817880:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147359104:0@lo:8:kworker.0 00000040:00080000:2.0:1788592857.818554:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788592857.818828:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788592857.818861:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788592857.818882:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ca7 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.818893:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f5c00/0x27b316f132511ca0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511ca7 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788592857.818963:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788592857.818966:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.818967:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.818969:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.818971:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.818972:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.818974:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.818976:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.818978:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592857.818983:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788592857.818985:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788592857.818987:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.818988:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.818989:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.818995:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.818996:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.818996:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.818997:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.818998:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788592857.819027:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788592857.819048:0:15755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147359488:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788592857.819115:0:15755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592857.819154:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359488 00000100:00100000:2.0:1788592857.819161:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359488 00000100:00100000:2.0:1788592857.819283:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788592857.819293:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:15755:x1875475147359488:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788592857.819325:0:14347:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788592857.819341:0:14347:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788592857.819524:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592857.820846:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147358976 00000100:00100000:3.0:1788592857.820861:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147358976 00000100:00100000:3.0:1788592857.820927:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592857.820937:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147358976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592857.821031:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147358976:12345-0@lo:400:kworker.0 Request processed in 95us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592857.821039:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592857.821092:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147358976:0@lo:400:kworker.0 00010000:00080000:1.0:1788592857.821644:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087922a00 x1875475147359232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592857.821659:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3286:1875475147359232:0@lo:400:kworker.0 00010000:00080000:1.0:1788592857.821692:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff898087923800 x1875475147359360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592857.821702:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147359360:0@lo:400:kworker.0 00000100:00100000:2.0:1788592857.823237:0:15755:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981bc0393c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788592857.862954:0:14347:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788592857.862988:0:14347:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788592857.863117:0:14370:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788592857.863125:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788592857.863155:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.863180:0:14370:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b96 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.863262:0:14370:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.863319:0:14370:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 19 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592857.863337:0:14370:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 19 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592857.863439:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147359616:0@lo:104: 00000100:00100000:0.0:1788592857.863532:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592857.863589:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081240 going to sleep for 11 seconds 00000100:00100000:2.0:1788592857.864184:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359616 00000100:00100000:2.0:1788592857.864194:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359616 00000100:00100000:2.0:1788592857.864266:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592857.864278:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147359616:12345-0@lo:104: 00010000:00010000:2.0:1788592857.864297:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.864455:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788592857.864462:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:14370:x1875475147359616:12345-0@lo:104: Request processed in 187us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.864469:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788592857.864498:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592857.864507:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592857.864515:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981c20e9000 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592857.864520:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592857.864529:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592857.864538:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592857.864566:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788592857.864612:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592857.864620:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592857.864639:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592857.864648:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981c20e9000/0x27b316f132511b96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b9d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592857.864669:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592857.864671:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592857.864673:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592857.866179:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147359744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788592857.866271:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592857.866410:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14370:1875475147359616:0@lo:104: 00010000:00010000:1.0:1788592857.866449:0:14370:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592857.866595:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359744 00000100:00100000:2.0:1788592857.866603:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359744 00010000:00010000:2.0:1788592857.866644:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 20 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592857.866696:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592857.866704:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+20:3284:x1875475147359744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592857.866719:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592857.866725:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 20 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866738:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 20 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866759:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccb800/0x27b316f132511b9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511b96 expref: 20 pid: 14350 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866779:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866788:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788592857.866805:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003681814s 00010000:00010000:2.0:1788592857.866811:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866818:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866825:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866832:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866845:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccac00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592857.866850:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866860:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866883:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592857.866904:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592857.866952:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3284:x1875475147359744:12345-0@lo:103:ldlm_bl.0 Request processed in 250us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592857.866960:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592857.867130:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147359744:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788592857.867346:0:14370:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.867395:0:14370:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592857.867402:0:14370:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccac00/0x27b316f132511cc3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592857.877963:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+18:15755:x1875475147359488:12345-0@lo:253:mount.lustre.0 Request processed in 58655us (58830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592857.877986:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788592857.878134:0:15755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7e8219ee-ba92-4a43-886c-289e43c7369c:15755:1875475147359488:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788592857.878154:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788592857.878157:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788592857.878160:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788592857.878161:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788592857.878162:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788592857.878163:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788592857.878164:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788592857.878166:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788592857.878168:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788592857.878169:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788592857.878198:0:15755:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788592857.888708:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592857.888882:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592857.890501:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788592857.890763:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788592857.890928:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788592857.892800:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788592857.893791:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788592857.984728:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788592858.078131:0:15755:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788592858.078164:0:15755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788592858.078292:0:15755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788592858.078433:0:15755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788592858.078449:0:15755:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788592858.078489:0:15755:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:0.0:1788592858.566800:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788592859.014601:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788592859.454685:0:14352:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788592859.454693:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8981c0d8e000 from 8 10000000:01000000:2.0:1788592859.454698:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788592859.454753:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.454767:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.454779:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592859.454810:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147359872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788592859.454891:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592859.454944:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898086a7a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788592859.455011:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147359872 00000100:00100000:2.0:1788592859.455020:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147359872 00000100:00100000:2.0:1788592859.455077:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788592859.455088:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bb22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147359872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592859.455105:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592859.455120:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981885f5000/0x27b316f132511cd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511cca expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.455145:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981885f5000/0x27b316f132511cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511cca expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.455170:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981885f5000/0x27b316f132511cd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511cca expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.455180:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981885f5000, rc 0) 00000100:00100000:2.0:1788592859.455218:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bb22dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147359872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592859.455225:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788592859.455302:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147359872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592859.455318:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511cd1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.455327:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511cd1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592859.455416:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147360000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788592859.455445:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592859.455467:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981885a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592859.455526:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360000 00000100:00100000:2.0:1788592859.455531:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360000 00000100:00100000:2.0:1788592859.455554:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592859.455560:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147360000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788592859.455575:0:14347:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788592859.455594:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788592859.455597:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788592859.455680:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147360000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592859.455696:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788592859.455728:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147360000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788592859.455790:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788592859.455797:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511cd1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592859.455806:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981885f5600/0x27b316f132511cca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511cd1 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592860.034433:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592861.056447:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592862.079037:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592862.465286:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147360128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592862.465419:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592862.465509:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360128 00000100:00100000:0.0:1788592862.465518:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360128 00000100:00100000:0.0:1788592862.465585:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788592862.465597:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147360128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788592862.465640:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592862.465693:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1875475147360128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592862.465716:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788592862.465741:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592862.465787:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147360128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592862.974597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788592862.974606:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788592862.974611:0:37:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788592862.974626:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff898084810800 using connection 192.168.204.120@tcp/0@lo 00000100:00100000:2.0:1788592862.974656:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592862.974657:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8981bd15df80 x1875475147360512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788592862.974732:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147360768:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.974750:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147360384:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.974833:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592862.974833:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592862.974918:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147360256:0@lo:400:kworker.0 00000100:00100000:0.0:1788592862.974935:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592862.974946:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147360640:0@lo:400:kworker.0 00000100:00100000:1.0:1788592862.974964:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592862.974989:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592862.974999:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147360896:0@lo:400:kworker.0 00000100:00100000:0.0:1788592862.975030:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360768 00000100:00100000:1.0:1788592862.975037:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592862.975041:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360768 00000100:00100000:1.0:1788592862.975074:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360640 00000100:00100000:1.0:1788592862.975080:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360640 00000100:00100000:0.0:1788592862.975100:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360896 00000100:00100000:0.0:1788592862.975106:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360896 00000100:00100000:1.0:1788592862.975119:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592862.975137:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147360768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592862.975301:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788592862.975311:0:14354:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1788592862.975342:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788592862.975468:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592862.975476:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147360640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592862.975520:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147360640:12345-0@lo:400:kworker.0 Request processed in 44us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592862.975527:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788592862.975557:0:14354:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788592862.975565:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788592862.975571:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147360896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788592862.975611:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147360896:12345-0@lo:400:kworker.0 Request processed in 41us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592862.975617:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788592862.975660:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15ce00 x1875475147360640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788592862.975675:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147360640:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.975808:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147360512:0@lo:8:kworker.0 00000100:00100000:2.0:1788592862.975844:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592862.975886:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360384 00000100:00100000:2.0:1788592862.975890:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360384 00000100:00100000:1.0:1788592862.975903:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147360768:12345-0@lo:400:kworker.0 Request processed in 774us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592862.975910:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788592862.975939:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15e680 x1875475147360768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592862.975949:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147360768:0@lo:400:kworker.0 00010000:00080000:1.0:1788592862.975980:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15c380 x1875475147360896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592862.975995:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360512 00000100:00100000:2.0:1788592862.975999:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360512 00000100:00100000:1.0:1788592862.976003:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147360896:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.976014:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592862.976021:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147360384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.976058:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147360384:12345-0@lo:400:kworker.0 Request processed in 38us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592862.976064:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788592862.976077:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592862.976089:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3282:x1875475147360512:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788592862.976116:0:15039:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1788592862.976150:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x27b316f132511cd8 00002000:00100000:2.0:1788592862.976165:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89808584d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788592862.976170:0:15039:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788592862.976173:0:15039:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788592862.976587:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788592862.976613:0:15039:0:(import.c:65:import_set_state_nolock()) ffff89808584e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592862.976654:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875475147360512:12345-0@lo:8:kworker.0 Request processed in 564us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592862.976660:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592862.976699:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147360256 00000100:00100000:2.0:1788592862.976703:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147360256 00000100:00100000:2.0:1788592862.976729:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788592862.976735:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3286:x1875475147360256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.976768:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf313450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3286:x1875475147360256:12345-0@lo:400:kworker.0 Request processed in 33us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592862.976773:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788592862.976817:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bd15df80 x1875475147360512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788592887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788592862.976830:0:3282:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788592862.976838:0:3282:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788592862.976843:0:3282:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788592862.976845:0:3282:0:(import.c:65:import_set_state_nolock()) ffff898084810800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788592862.976859:0:3282:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788592862.976863:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3282:1875475147360512:0@lo:8:kworker.0 00000004:00080000:2.0:1788592862.976929:0:14379:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788592862.976948:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875475147361152:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788592862.976973:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592862.976988:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff898085081f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592862.976999:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147361024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592862.977020:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592862.977047:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361024 00000100:00100000:2.0:1788592862.977050:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361024 00000100:00100000:2.0:1788592862.977082:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788592862.977088:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147361024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788592862.977111:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592862.977141:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147361024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592862.977146:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788592862.977158:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788592862.977620:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8981bc5d3480 x1875475147361024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788592878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788592862.977635:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147361024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592862.977659:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147360256:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.977683:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147360384:0@lo:400:kworker.0 00000100:00100000:2.0:1788592862.977699:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361152 00000100:00100000:2.0:1788592862.977703:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361152 00000100:00100000:2.0:1788592862.977724:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788592862.977729:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1875475147361152:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788592862.979177:0:14378:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788592862.982584:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 437223230729ns, next at 0ns, rc = 0 00002000:00080000:2.0:1788592862.985863:0:15039:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788592862.985879:0:15039:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788592862.985887:0:15039:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788592863.003624:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.003639:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.003660:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.003665:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.003742:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.003766:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.003778:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.003786:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.003822:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592863.005766:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.005779:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005801:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.005814:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.005821:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005837:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005848:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005856:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005875:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592863.005888:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592863.005895:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005903:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4e00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.005909:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005926:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005946:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005963:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511cdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005982:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592863.005985:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.005991:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4a00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.005995:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.006002:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.006014:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.006021:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511ce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.006034:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.006036:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.006038:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.006638:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.007911:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.007926:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.007952:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.007957:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.007964:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.007980:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.007992:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008000:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008020:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592863.008034:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592863.008040:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008049:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.008054:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008065:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008097:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008105:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511ced lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.008126:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.008129:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.008131:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.009617:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.009629:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009644:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.009648:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.009655:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009668:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009746:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009754:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009787:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788592863.009802:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592863.009809:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009816:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.009822:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009833:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009851:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009859:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511cf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.009875:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.009877:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.009878:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.013918:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.013939:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.013964:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.013978:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.013987:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.014093:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.014110:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.014118:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.014151:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592863.016804:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.016825:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016850:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.016856:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.016866:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016887:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016902:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016926:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016949:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788592863.016969:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788592863.016978:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.016987:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.016993:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017089:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017117:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017127:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511cfb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017154:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788592863.017158:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017178:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592863.017183:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017192:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017285:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017390:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.017405:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.017407:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.017409:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.018196:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.019147:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.019162:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.019183:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.019188:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.019196:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.020684:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.020719:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.020729:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.020762:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592863.021265:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592863.021276:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.021289:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592863.021296:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.021331:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.021383:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.021392:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.021421:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.021423:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.021425:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.035483:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.036288:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.036330:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.036337:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.036346:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.036394:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.036408:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.036417:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.036447:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.038435:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.038451:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.038466:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.038471:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.038484:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.038510:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.038520:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.038549:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.038551:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.038553:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.042777:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.042797:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.042819:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.042824:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.042831:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.042849:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.042861:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.042870:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.042906:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592863.042924:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592863.042935:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.042947:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592863.042953:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.042965:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.042988:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.043009:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b004115/0x27b316f132511d17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.043032:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.043034:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.043037:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.044126:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.044137:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.044151:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.044162:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.044168:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.044182:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.044193:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.044260:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.044279:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.044449:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.044457:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.044465:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.044470:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.044479:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.044493:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.044500:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd8c3a9b/0x27b316f132511d1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.044516:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.044518:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.044520:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.045434:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.045444:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.045456:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.045460:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.045464:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.045474:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.045483:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.045565:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.045584:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592863.046305:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.046438:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.046450:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.046453:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.046459:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.046471:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.046480:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.046487:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.046590:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788592863.047254:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.047263:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047280:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.047284:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.047289:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047302:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047330:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047338:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047386:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788592863.047951:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.047958:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047968:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.047971:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.047975:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.047986:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048022:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048040:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048060:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788592863.048566:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.048572:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048581:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.048584:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.048588:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048598:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048606:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048614:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.048633:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788592863.049126:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788592863.049137:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049158:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049165:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592863.049177:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788592863.049177:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049188:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049199:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1788592863.049204:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049214:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc2d5f88/0x27b316f132511d25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049234:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788592863.049239:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049245:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4a00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049248:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049255:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049263:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049276:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000652e09bd/0x27b316f132511d2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049288:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788592863.049292:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049297:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4e00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049299:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049306:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049328:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049336:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054e8adf2/0x27b316f132511d33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049346:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592863.049581:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049590:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f5800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049600:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049609:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049620:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049627:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f20a76/0x27b316f132511d3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049641:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.049645:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049651:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049654:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049662:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049672:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049679:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac6e6130/0x27b316f132511d41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049698:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.049700:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.049702:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.049733:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.049739:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049751:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049759:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049766:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.049783:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.049866:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.049872:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049879:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a04800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.049883:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049892:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.049904:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.050092:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8512a5a/0x27b316f132511d48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.050110:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.050113:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.050114:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.051012:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.051023:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.051038:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.051050:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.051057:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.051072:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.051085:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.051094:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.051118:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.051565:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.051574:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.051595:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a04c00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.051600:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.051610:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.051630:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.051639:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006284ade1/0x27b316f132511d4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.051662:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.051665:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.051667:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.052099:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788592863.053130:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.053143:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.053162:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.053166:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.053174:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.053190:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.053276:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.053781:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788592863.058456:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788592863.062452:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592863.064561:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.064577:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.064593:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05e00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.064599:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.064613:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.064642:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.064651:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132511d56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.064677:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.064679:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.064681:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.064829:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.064838:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.064851:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.064857:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.064866:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.064886:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.064896:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.064904:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.064945:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592863.065019:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.065025:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.065033:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.065042:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.065050:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.065061:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.065068:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fe5f754/0x27b316f132511d5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.065085:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.065087:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.065090:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.067824:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.067842:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.067861:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.067867:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.067874:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.067890:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.067903:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.067911:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.067938:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592863.068287:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.068297:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.068306:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.068322:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.068333:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.068385:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.068403:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f416548f/0x27b316f132511d64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.068423:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.068425:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.068427:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.068965:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.068973:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.068983:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.068991:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.068996:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069007:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069016:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069023:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069079:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788592863.069536:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.069541:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069550:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.069552:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.069556:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069565:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069572:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.069584:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069820:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788592863.069827:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069836:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ea00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.069840:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069849:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069867:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069875:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000885f7974/0x27b316f132511d6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069894:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.069898:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069911:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ee00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.069915:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069925:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069934:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.069943:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.069945:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.069946:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592863.069991:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788592863.069996:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fde352a/0x27b316f132511d72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.070250:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.073173:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.073776:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.073799:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.073805:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.073812:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.073831:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.073845:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.073854:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.073897:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592863.074277:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.074287:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.074296:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fe00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.074301:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.074325:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.074347:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.074435:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b9d53c7/0x27b316f132511d79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.074464:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.074466:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.074468:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.075943:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.075956:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.075974:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.075979:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.075985:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.075999:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.076009:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.076017:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.076041:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788592863.076294:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788592863.076302:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.076311:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592863.076326:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.076336:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.076369:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.076378:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f132511d80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592863.076402:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.076404:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592863.076405:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788592863.076423:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788592863.077850:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.077861:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.077875:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.077879:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.077884:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.077897:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.077907:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078034:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078097:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788592863.078605:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788592863.078612:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078631:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=437s v=(0 0) 00010000:00010000:2.0:1788592863.078634:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592863.078639:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078650:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078658:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592863.078667:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081061:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788592863.081080:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081097:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.081104:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081130:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081161:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081171:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f132511d87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081199:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.081203:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081209:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a04600 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.081212:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081219:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081229:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.081237:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.081239:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.081247:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592863.085120:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788592863.085143:0:15039:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6104bd9/0x27b316f132511d8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087141:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.087239:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.087252:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.087274:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.087287:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.087295:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.087323:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.087336:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.087344:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.087383:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.087469:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.087479:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087488:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.087493:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087503:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087524:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087532:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072344c62/0x27b316f132511d95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.087993:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.087997:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.087999:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788592863.088204:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788592863.088211:0:15039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.088222:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=437s v=(0 0) 00010000:00010000:3.0:1788592863.088226:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592863.088231:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.088241:0:15039:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.088251:0:15039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.088265:0:15039:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592863.088293:0:15039:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788592863.088530:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788592863.088537:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788592863.088541:0:15039:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00010000:00010000:0.0:1788592863.088546:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:0.0:1788592863.088550:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.088565:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.088577:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.088584:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbf17738/0x27b316f132511d9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592863.088598:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.088599:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592863.088601:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592863.088665:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14379:x1875475147361152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 110929us (111685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592863.088729:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875475147361152:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788592863.088753:0:14379:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788592863.088813:0:14379:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875475147361280:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788592863.088867:0:14379:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592863.088931:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788592863.088964:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361280 00000100:00100000:3.0:1788592863.088971:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361280 00000100:00100000:3.0:1788592863.089015:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788592863.089021:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788592863.089024:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14379:x1875475147361280:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788592863.089029:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788592863.089187:0:14379:0:(client.c:2716:ptlrpc_set_wait()) set ffff8981885a4d80 going to sleep for 11 seconds 00002000:00080000:3.0:1788592863.089300:0:15039:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788592863.102414:0:14379:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14379:1875475147361280:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788592863.102446:0:14379:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788592863.102606:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14379:x1875475147361280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13317us (13473us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788592863.102624:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788592863.103469:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592864.126760:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592865.155969:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788592865.427931:0:16113:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg420-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788592866.175545:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592867.199448:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592867.583390:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788592867.583417:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147361408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592867.583500:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592867.583578:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361408 00000100:00100000:2.0:1788592867.583587:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361408 00000100:00100000:2.0:1788592867.583642:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592867.583653:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147361408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592867.583695:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592867.583746:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147361408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.583753:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788592867.583776:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788592867.583814:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147361408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592867.833188:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.833321:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881664 00000100:00100000:2.0:1788592867.833343:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881664 00000100:00100000:2.0:1788592867.833611:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:2.0:1788592867.833622:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2340:x1875475136881664:12345-192.168.204.20@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788592867.833657:0:14349:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 92e91180-c6da-4b6e-8b51-7ef4ca1db3b6@192.168.204.20@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788592867.833690:0:14349:0:(genops.c:1385:class_connect()) connect: client 92e91180-c6da-4b6e-8b51-7ef4ca1db3b6, cookie 0x27b316f132511da3 00000100:00080000:2.0:1788592867.833844:0:14349:0:(import.c:65:import_set_state_nolock()) ffff898085848800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788592867.833924:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+5:2340:x1875475136881664:12345-192.168.204.20@tcp:250:mount.lustre.0 Request processed in 302us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.833934:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 76 00000100:00100000:1.0:1788592867.842882:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592867.843640:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881792 00000100:00100000:3.0:1788592867.843651:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881792 00000100:00100000:3.0:1788592867.843716:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:3.0:1788592867.843726:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+5:13751:x1875475136881792:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788592867.843743:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592867.843763:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762fa00/0x27b316f132511daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d7d expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592867.843792:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762fa00/0x27b316f132511daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d7d expref: 6 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592867.843805:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762fa00/0x27b316f132511daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d7d expref: 6 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592867.843825:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fa00, rc 0) 00000100:00100000:3.0:1788592867.843889:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf311850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+6:13751:x1875475136881792:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 165us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592867.843897:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 77 00000100:00100000:0.0:1788592867.848289:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592867.849711:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136881920 00000100:00100000:1.0:1788592867.849726:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136881920 00000100:00100000:1.0:1788592867.849857:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:1.0:1788592867.849868:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+6:13751:x1875475136881920:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592867.850686:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf313850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+6:13751:x1875475136881920:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 816us (2402us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592867.850697:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 78 00000100:00100000:3.0:1788592867.855512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592867.855610:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882048 00000100:00100000:0.0:1788592867.855628:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882048 00000100:00100000:1.0:1788592867.856145:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:1.0:1788592867.856160:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+6:13751:x1875475136882048:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592867.856179:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592867.856200:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988be000/0x27b316f132511db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1d84 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592867.856239:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988be000/0x27b316f132511db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d84 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592867.856252:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988be000/0x27b316f132511db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1d84 expref: 7 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592867.856284:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988be000, rc 0) 00000100:00100000:1.0:1788592867.856397:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf312850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+7:13751:x1875475136882048:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 242us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592867.856405:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 79 00000100:00100000:2.0:1788592867.864948:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592867.865146:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882176 00000100:00100000:1.0:1788592867.865164:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882176 00000100:00100000:1.0:1788592867.865251:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:1.0:1788592867.865262:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+7:13751:x1875475136882176:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592867.865641:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13751:x1875475136882176:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 380us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592867.865649:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 80 00000100:00100000:0.0:1788592867.874681:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592867.874768:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882304 00000100:00100000:3.0:1788592867.874789:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882304 00000100:00100000:2.0:1788592867.875090:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:2.0:1788592867.875103:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13751:x1875475136882304:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788592867.875474:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13751:x1875475136882304:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 373us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.875484:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 81 00000100:00100000:3.0:1788592867.880026:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.881251:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882432 00000100:00100000:2.0:1788592867.881270:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882432 00000100:00100000:2.0:1788592867.881395:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:2.0:1788592867.881409:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13771:x1875475136882432:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592867.881788:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13771:x1875475136882432:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 381us (1777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.881798:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 82 00000100:00100000:3.0:1788592867.901760:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592867.902183:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882560 00000100:00100000:1.0:1788592867.902196:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882560 00000100:00100000:1.0:1788592867.902278:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1788592867.902290:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13771:x1875475136882560:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592867.902701:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13771:x1875475136882560:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 411us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592867.902711:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 83 00000100:00100000:1.0:1788592867.908598:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592867.908974:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882688 00000100:00100000:0.0:1788592867.908989:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882688 00000100:00100000:0.0:1788592867.909057:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:0.0:1788592867.909070:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+8:13751:x1875475136882688:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788592867.909098:0:14347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592867.909121:0:14347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccb600/0x27b316f132511db8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1dae expref: -99 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592867.909174:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccb600/0x27b316f132511db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1dae expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592867.909188:0:14347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccb600/0x27b316f132511db8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1dae expref: 9 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592867.909200:0:14347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb600, rc 0) 00000100:00100000:0.0:1788592867.909281:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+9:13751:x1875475136882688:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 214us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592867.909288:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 84 00000100:00100000:3.0:1788592867.916131:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.916411:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882816 00000100:00100000:2.0:1788592867.916424:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882816 00000100:00100000:2.0:1788592867.916479:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:2.0:1788592867.916490:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+9:13751:x1875475136882816:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788592867.916521:0:14349:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788592867.916549:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788592867.916553:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788592867.916556:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788592867.916559:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788592867.918979:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+9:13751:x1875475136882816:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 2476us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.918996:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 85 00000100:00100000:1.0:1788592867.922636:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.922803:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136882944 00000100:00100000:2.0:1788592867.922817:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136882944 00000100:00100000:2.0:1788592867.923022:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:2.0:1788592867.923036:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+9:13751:x1875475136882944:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592867.923062:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592867.923097:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1db5 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592867.923133:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592867.923146:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 10 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592867.923158:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04e00, rc 0) 00000100:00100000:2.0:1788592867.923240:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13751:x1875475136882944:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 206us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.923248:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 86 00000100:00100000:3.0:1788592867.926393:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592867.927159:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883072 00000100:00100000:0.0:1788592867.927175:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883072 00000100:00100000:1.0:1788592867.931114:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:1.0:1788592867.931156:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13751:x1875475136883072:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592867.931601:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13751:x1875475136883072:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 465us (5262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592867.931619:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 87 00000100:00100000:2.0:1788592867.937720:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592867.937832:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883200 00000100:00100000:0.0:1788592867.937845:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883200 00000100:00100000:0.0:1788592867.937924:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:0.0:1788592867.937937:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13751:x1875475136883200:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788592867.938480:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13751:x1875475136883200:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 543us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592867.938490:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 88 00000100:00100000:0.0:1788592867.945968:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.946193:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883328 00000100:00100000:2.0:1788592867.946206:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883328 00000100:00100000:2.0:1788592867.946286:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:2.0:1788592867.946297:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13775:x1875475136883328:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592867.946666:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13775:x1875475136883328:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 369us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592867.946675:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 89 00000100:00100000:2.0:1788592867.956517:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592867.956662:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883456 00000100:00100000:1.0:1788592867.956677:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883456 00000100:00100000:1.0:1788592867.956747:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:1.0:1788592867.956759:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13775:x1875475136883456:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592867.957321:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13775:x1875475136883456:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 562us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592867.957331:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 90 00000100:00100000:0.0:1788592867.963645:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592867.964271:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883584 00000100:00100000:2.0:1788592867.964286:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883584 00000100:00100000:2.0:1788592867.964411:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1788592867.964422:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1875475136883584:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788592867.964467:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf@192.168.204.20@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:2.0:1788592867.964525:0:14354:0:(genops.c:1385:class_connect()) connect: client a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf, cookie 0x27b316f132511dc6 00000004:00100000:2.0:1788592867.964566:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1788592867.964576:0:14354:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788592868.018274:0:14354:0:(import.c:65:import_set_state_nolock()) ffff8981bcffb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592868.018414:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2340:x1875475136883584:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 53991us (54792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592868.018428:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592868.021619:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592868.021698:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592868.021798:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883840 00000100:00100000:1.0:1788592868.021811:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883840 00000100:00100000:1.0:1788592868.021909:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883712 00000100:00100000:1.0:1788592868.021913:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883712 00000100:00100000:1.0:1788592868.021939:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1788592868.021951:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:13751:x1875475136883840:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592868.022011:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788592868.022127:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:13751:x1875475136883840:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 177us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.022135:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:1.0:1788592868.022154:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592868.022161:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:0:x1875475136883712:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592868.022173:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788592868.022196:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:0:x1875475136883712:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 35us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.022202:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:3.0:1788592868.022889:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592868.025273:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592868.026186:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136883968 00000100:00100000:2.0:1788592868.026202:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136883968 00000100:00100000:2.0:1788592868.026300:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1788592868.026314:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13751:x1875475136883968:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788592868.026483:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13751:x1875475136883968:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 171us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592868.026492:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1788592868.030982:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592868.031025:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592868.031070:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592868.031120:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592868.031159:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884096 00000100:00100000:0.0:1788592868.031173:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884096 00000100:00100000:0.0:1788592868.031216:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884224 00000100:00100000:0.0:1788592868.031231:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884224 00000100:00100000:0.0:1788592868.031253:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1788592868.031263:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875475136884096:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788592868.031305:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf@192.168.204.20@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1788592868.031378:0:15038:0:(genops.c:1385:class_connect()) connect: client a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf, cookie 0x27b316f132511dcd 00002000:00100000:0.0:1788592868.031395:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf/ffff8981bcfff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592868.031409:0:15038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788592868.031868:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788592868.031906:0:15038:0:(import.c:65:import_set_state_nolock()) ffff898193842000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592868.031993:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2340:x1875475136884096:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 730us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592868.032002:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:0.0:1788592868.032025:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1788592868.032030:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2340:x1875475136884224:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788592868.032048:0:15038:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf@192.168.204.20@tcp t0 exp 0000000000000000 cur 442 last 0 00000020:00000080:0.0:1788592868.032067:0:15038:0:(genops.c:1385:class_connect()) connect: client a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf, cookie 0x27b316f132511dd4 00002000:00100000:0.0:1788592868.032073:0:15038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf/ffff898184fef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788592868.032115:0:15038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788592868.032267:0:15038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788592868.032283:0:15038:0:(import.c:65:import_set_state_nolock()) ffff898184fea000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592868.032307:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2340:x1875475136884224:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 275us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592868.032313:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592868.032761:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884480 00000100:00100000:2.0:1788592868.032775:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884480 00000100:00100000:2.0:1788592868.032834:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:2.0:1788592868.032842:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:2342:x1875475136884480:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592868.032881:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:2342:x1875475136884480:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 41us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592868.032887:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 91 00000100:00100000:3.0:1788592868.033060:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884352 00000100:00100000:3.0:1788592868.033066:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884352 00000100:00100000:3.0:1788592868.033435:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1788592868.033445:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13751:x1875475136884352:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788592868.035108:0:14357:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1588us 00000004:00200000:3.0:1788592868.050531:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788592868.050688:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13751:x1875475136884352:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 17237us (19713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592868.050700:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:1.0:1788592868.094663:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147361536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592868.094758:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592868.094990:0:15041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361536 00000100:00100000:3.0:1788592868.095002:0:15041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361536 00000100:00100000:3.0:1788592868.095090:0:15041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592868.095101:0:15041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147361536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592868.095133:0:15041:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788592868.095195:0:15041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087923b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1875475147361536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592868.095229:0:15041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788592868.095256:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592868.095466:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147361920:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095505:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592868.095531:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788592868.095537:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147361792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095563:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592868.095606:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361792 00000100:00100000:1.0:1788592868.095610:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361792 00000100:00100000:1.0:1788592868.095644:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592868.095651:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147361792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095691:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147361792:12345-0@lo:400:kworker.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.095698:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788592868.095739:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147361792:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095759:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147362048:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095779:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592868.095809:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3285:1875475147361536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592868.095821:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788592868.095825:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147361664:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095856:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592868.095880:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147362176:0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.095902:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592868.095938:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361920 00000100:00100000:2.0:1788592868.095943:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361920 00000100:00100000:2.0:1788592868.095991:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362048 00000100:00100000:2.0:1788592868.095995:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362048 00000100:00100000:2.0:1788592868.096015:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362176 00000100:00100000:2.0:1788592868.096018:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362176 00000100:00100000:2.0:1788592868.096032:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788592868.096048:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147361920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.096173:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592868.096188:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147362048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.096245:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147362048:12345-0@lo:400:kworker.0 Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.096253:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788592868.096269:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592868.096276:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147362176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.096304:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1875475147362176:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.096310:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788592868.096427:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147361664 00000100:00100000:1.0:1788592868.096432:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147361664 00000100:00100000:1.0:1788592868.096460:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788592868.096467:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3285:x1875475147361664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592868.096498:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3285:x1875475147361664:12345-0@lo:400:kworker.0 Request processed in 32us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.096504:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788592868.096588:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592868.096662:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147361920:12345-0@lo:400:kworker.0 Request processed in 614us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592868.096669:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592868.096737:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7e8219ee-ba92-4a43-886c-289e43c7369c:3285:1875475147361664:0@lo:400:kworker.0 00010000:00080000:3.0:1788592868.096756:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898087921c00 x1875475147362176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592868.096767:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3285:1875475147362176:0@lo:400:kworker.0 00010000:00080000:3.0:1788592868.096776:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898087920000 x1875475147362048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788592868.096783:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147362048:0@lo:400:kworker.0 00010000:00080000:1.0:1788592868.097163:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff898087920700 x1875475147361920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788592884 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788592868.097174:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147361920:0@lo:400:kworker.0 00000001:00100000:3.0:1788592868.189921:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf 00000001:00080000:3.0:1788592868.190276:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788592868.222548:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592868.251835:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592868.251961:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884608 00000100:00100000:1.0:1788592868.252060:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884608 00000100:00100000:1.0:1788592868.252179:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592868.252192:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13796:x1875475136884608:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:1.0:1788592868.252234:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592868.252273:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511ddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ddf expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252418:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252438:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252462:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592868.252518:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788592868.252523:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592868.252569:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252602:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ddf expref: 8 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252625:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ddf expref: 7 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592868.252636:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592868.252639:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788592868.252644:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf600, rc 0) 00000100:00100000:1.0:1788592868.252739:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:13796:x1875475136884608:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 549us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592868.252748:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000040:00080000:3.0:1788592868.801504:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788592869.249653:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592870.266400:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.266566:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884736 00000100:00100000:2.0:1788592870.266579:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884736 00000100:00080000:0.0:1788592870.266740:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788592870.266774:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:2.0:1788592870.266789:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:13848:x1875475136884736:12345-192.168.204.20@tcp:41:lfs.0 00000004:00000024:2.0:1788592870.266853:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788592870.267081:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:13848:x1875475136884736:12345-192.168.204.20@tcp:41:lfs.0 Request processed in 290us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.267090:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00010000:00010000:0.0:1788592870.276402:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592870.285594:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.285789:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884864 00000100:00100000:0.0:1788592870.285802:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884864 00000100:00100000:0.0:1788592870.285887:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:0.0:1788592870.285899:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13848:x1875475136884864:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:0.0:1788592870.285958:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788592870.286072:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:13848:x1875475136884864:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 175us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.286081:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00080000:2.0:1788592870.286890:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788592870.293221:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.293558:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136884992 00000100:00100000:2.0:1788592870.293573:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136884992 00000100:00100000:2.0:1788592870.293687:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:2.0:1788592870.293700:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:13848:x1875475136884992:12345-192.168.204.20@tcp:13:lfs.0 00002000:00000024:2.0:1788592870.293763:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592870.293873:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd15c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:13848:x1875475136884992:12345-192.168.204.20@tcp:13:lfs.0 Request processed in 177us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.293882:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00080000:0.0:1788592870.295808:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592870.527249:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.527798:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885120 00000100:00100000:2.0:1788592870.527813:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885120 00000100:00100000:2.0:1788592870.527930:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:2.0:1788592870.527944:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+10:13882:x1875475136885120:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592870.527976:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592870.528001:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff898086a05600/0x27b316f132511de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1de6 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.528040:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff898086a05600/0x27b316f132511de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1de6 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.528053:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff898086a05600/0x27b316f132511de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1de6 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.528064:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a05600, rc 0) 00000100:00100000:2.0:1788592870.528143:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885120:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 202us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.528151:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 93 00000100:00100000:3.0:1788592870.531544:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.537223:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885248 00000100:00100000:1.0:1788592870.537247:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885248 00000100:00100000:1.0:1788592870.537332:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:1.0:1788592870.537344:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898196c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885248:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788592870.540067:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898196c8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885248:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 2709us (8523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.540085:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 94 00000100:00100000:0.0:1788592870.542378:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.542500:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885376 00000100:00100000:1.0:1788592870.542512:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885376 00000100:00100000:1.0:1788592870.542646:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:1.0:1788592870.542668:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885376:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788592870.543164:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885376:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 506us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.543183:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 95 00000100:00100000:3.0:1788592870.546184:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.548217:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885504 00000100:00100000:2.0:1788592870.548239:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885504 00000100:00100000:2.0:1788592870.548308:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:2.0:1788592870.548319:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13887:x1875475136885504:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592870.549336:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13887:x1875475136885504:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 1009us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.549389:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 96 00000100:00100000:3.0:1788592870.562252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.562405:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885632 00000100:00100000:1.0:1788592870.562418:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885632 00000100:00100000:1.0:1788592870.562489:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:1.0:1788592870.562501:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13887:x1875475136885632:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788592870.570964:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13887:x1875475136885632:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 8448us (8710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.570984:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 97 00000100:00100000:0.0:1788592870.575856:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.576147:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885760 00000100:00100000:2.0:1788592870.576159:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885760 00000100:00100000:2.0:1788592870.576237:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:2.0:1788592870.576248:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13882:x1875475136885760:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788592870.576270:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592870.576310:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff898086a04a00/0x27b316f132511df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e10 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.576391:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff898086a04a00/0x27b316f132511df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e10 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.576405:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff898086a04a00/0x27b316f132511df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e10 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592870.576417:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04a00, rc 0) 00000100:00100000:2.0:1788592870.576484:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13882:x1875475136885760:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 237us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.576492:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 98 00000100:00100000:3.0:1788592870.580515:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.580605:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136885888 00000100:00100000:0.0:1788592870.580617:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136885888 00000100:00100000:0.0:1788592870.580949:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:0.0:1788592870.580963:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13882:x1875475136885888:12345-192.168.204.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788592870.580998:0:14347:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788592870.581036:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788592870.581042:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788592870.581045:0:14347:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788592870.581048:0:14347:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788592870.591398:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13882:x1875475136885888:12345-192.168.204.20@tcp:256:mount.lustre.0 Request processed in 10392us (10848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.591416:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 99 00000100:00100000:2.0:1788592870.597074:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.597280:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886016 00000100:00100000:1.0:1788592870.597295:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886016 00000100:00100000:1.0:1788592870.597384:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1788592870.597396:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13882:x1875475136886016:12345-192.168.204.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788592870.597419:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592870.597440:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e17 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592870.597505:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592870.597520:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592870.597531:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfe00, rc 0) 00000100:00100000:1.0:1788592870.598197:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13882:x1875475136886016:12345-192.168.204.20@tcp:101:mount.lustre.0 Request processed in 799us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.598206:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 100 00000100:00100000:1.0:1788592870.611275:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.613543:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886144 00000100:00100000:0.0:1788592870.613568:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886144 00000100:00100000:0.0:1788592870.613653:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:0.0:1788592870.613665:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13882:x1875475136886144:12345-192.168.204.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788592870.614101:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13882:x1875475136886144:12345-192.168.204.20@tcp:501:mount.lustre.0 Request processed in 437us (2840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.614323:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 101 00000100:00100000:2.0:1788592870.618720:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.618993:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886272 00000100:00100000:1.0:1788592870.619007:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886272 00000100:00100000:1.0:1788592870.619297:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:1.0:1788592870.619310:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13882:x1875475136886272:12345-192.168.204.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788592870.619731:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13882:x1875475136886272:12345-192.168.204.20@tcp:503:mount.lustre.0 Request processed in 422us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.619742:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 102 00000100:00100000:1.0:1788592870.626620:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592870.627274:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886400 00000100:00100000:2.0:1788592870.627288:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886400 00000100:00100000:2.0:1788592870.627434:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:2.0:1788592870.627446:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13892:x1875475136886400:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788592870.627899:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13892:x1875475136886400:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 453us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592870.627982:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 103 00000100:00100000:3.0:1788592870.639580:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.640757:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886528 00000100:00100000:1.0:1788592870.640786:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886528 00000100:00100000:1.0:1788592870.640875:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:1.0:1788592870.640887:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13892:x1875475136886528:12345-192.168.204.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788592870.641265:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13892:x1875475136886528:12345-192.168.204.20@tcp:502:llog_process_th.0 Request processed in 378us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.641285:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 104 00000100:00100000:3.0:1788592870.647291:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.647438:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886656 00000100:00100000:0.0:1788592870.647452:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886656 00000100:00100000:0.0:1788592870.647511:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:0.0:1788592870.647522:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2340:x1875475136886656:12345-192.168.204.20@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788592870.647562:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9535983c-d4f6-45d9-9ca5-ac83e3a6e841@192.168.204.20@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:0.0:1788592870.647620:0:14354:0:(genops.c:1385:class_connect()) connect: client 9535983c-d4f6-45d9-9ca5-ac83e3a6e841, cookie 0x27b316f132511dfe 00000004:00100000:0.0:1788592870.647690:0:14354:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788592870.647849:0:14354:0:(import.c:65:import_set_state_nolock()) ffff898184feb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788592870.649426:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2340:x1875475136886656:12345-192.168.204.20@tcp:38:mount.lustre.0 Request processed in 1890us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.649442:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592870.657875:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592870.658014:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886784 00000100:00100000:3.0:1788592870.658036:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886784 00000100:00080000:0.0:1788592870.658214:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788592870.658290:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1788592870.658302:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:0:x1875475136886784:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788592870.658344:0:14355:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788592870.658462:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:0:x1875475136886784:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 162us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592870.658490:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1788592870.659022:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.659848:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136886912 00000100:00100000:1.0:1788592870.659861:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136886912 00000100:00100000:1.0:1788592870.660036:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1788592870.660048:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136886912:12345-192.168.204.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788592870.660081:0:15998:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788592870.660159:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136886912:12345-192.168.204.20@tcp:41:mount.lustre.0 Request processed in 113us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.660177:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1788592870.663466:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592870.663637:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887040 00000100:00100000:3.0:1788592870.663650:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887040 00000100:00100000:3.0:1788592870.663814:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592870.663827:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136887040:12345-192.168.204.20@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788592870.664164:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136887040:12345-192.168.204.20@tcp:40:mount.lustre.0 Request processed in 339us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592870.664182:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592870.667564:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.667707:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887424 00000100:00100000:0.0:1788592870.667721:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887424 00000100:00100000:0.0:1788592870.667791:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:0.0:1788592870.667803:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136887424:12345-192.168.204.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788592870.667913:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788592870.668389:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13882:x1875475136887424:12345-192.168.204.20@tcp:33:mount.lustre.0 Request processed in 587us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.668398:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1788592870.669553:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592870.669597:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592870.669673:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887168 00000100:00100000:1.0:1788592870.669682:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887168 00000100:00100000:1.0:1788592870.669717:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887296 00000100:00100000:1.0:1788592870.669719:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887296 00000100:00100000:1.0:1788592870.669737:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1788592870.669744:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875475136887168:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788592870.669787:0:16006:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9535983c-d4f6-45d9-9ca5-ac83e3a6e841@192.168.204.20@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1788592870.669823:0:16006:0:(genops.c:1385:class_connect()) connect: client 9535983c-d4f6-45d9-9ca5-ac83e3a6e841, cookie 0x27b316f132511e05 00002000:00100000:1.0:1788592870.669836:0:16006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9535983c-d4f6-45d9-9ca5-ac83e3a6e841/ffff8981bccd5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592870.669848:0:16006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788592870.669995:0:16006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788592870.670040:0:16006:0:(import.c:65:import_set_state_nolock()) ffff8981bccd7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592870.670098:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc785500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2340:x1875475136887168:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 354us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.670219:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1788592870.670249:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1788592870.670253:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2340:x1875475136887296:12345-192.168.204.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788592870.670270:0:16006:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9535983c-d4f6-45d9-9ca5-ac83e3a6e841@192.168.204.20@tcp t0 exp 0000000000000000 cur 444 last 0 00000020:00000080:1.0:1788592870.670285:0:16006:0:(genops.c:1385:class_connect()) connect: client 9535983c-d4f6-45d9-9ca5-ac83e3a6e841, cookie 0x27b316f132511e0c 00002000:00100000:1.0:1788592870.670290:0:16006:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9535983c-d4f6-45d9-9ca5-ac83e3a6e841/ffff8981bccd3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788592870.670296:0:16006:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788592870.670537:0:16006:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788592870.670553:0:16006:0:(import.c:65:import_set_state_nolock()) ffff8981bccd6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788592870.670581:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2340:x1875475136887296:12345-192.168.204.20@tcp:8:mount.lustre.0 Request processed in 326us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592870.670588:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:1.0:1788592870.831383:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592870.831495:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887552 00000100:00100000:0.0:1788592870.831510:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887552 00000100:00100000:0.0:1788592870.831585:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:0.0:1788592870.831598:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:13913:x1875475136887552:12345-192.168.204.20@tcp:101:mkdir.0 00010000:00010000:0.0:1788592870.831825:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592870.831864:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511e13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e41 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.831954:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.831976:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.832018:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592870.832066:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592870.832070:0:14354:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592870.832093:0:14354:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.832127:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511e13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.832149:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592870.832161:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:0.0:1788592870.832163:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592870.832179:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb000, rc 0) 00000100:00100000:0.0:1788592870.832257:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+7:13913:x1875475136887552:12345-192.168.204.20@tcp:101:mkdir.0 Request processed in 662us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592870.832265:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:2.0:1788592871.294565:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788592872.318640:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592872.704256:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147362304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788592872.704425:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592872.704769:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362304 00000100:00100000:2.0:1788592872.704781:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362304 00000100:00100000:2.0:1788592872.704860:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788592872.704878:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147362304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788592872.704923:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788592872.704975:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087921c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147362304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592872.704982:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788592872.705318:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788592872.706601:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147362304:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788592872.745625:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf 00000001:00100000:0.0:1788592872.745646:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9535983c-d4f6-45d9-9ca5-ac83e3a6e841 00000100:00100000:1.0:1788592873.222463:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147362432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592873.222566:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.228997:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147362816:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.230165:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.230236:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788592873.230247:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147362944:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.230287:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.230409:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362432 00000100:00100000:1.0:1788592873.230419:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362432 00000100:00100000:1.0:1788592873.230562:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592873.230574:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147362432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592873.230683:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592873.230741:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147362432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (8175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592873.230749:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592873.230788:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147362688:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.230821:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.230849:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788592873.230855:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147362560:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.230886:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.230917:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147363072:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.230939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592873.230992:0:3284:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788592873.231020:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147362432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592873.231048:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362816 00000100:00100000:1.0:1788592873.231053:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362816 00000100:00100000:1.0:1788592873.231995:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362944 00000100:00100000:1.0:1788592873.232004:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362944 00000100:00100000:1.0:1788592873.232025:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363072 00000100:00100000:1.0:1788592873.232028:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363072 00000100:00100000:1.0:1788592873.232048:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788592873.232057:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147362816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592873.232107:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788592873.232128:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147362944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.232158:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875475147362816:12345-0@lo:400:kworker.0 Request processed in 101us (1999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592873.232168:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788592873.232178:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875475147362944:12345-0@lo:400:kworker.0 Request processed in 62us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592873.232189:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788592873.232204:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788592873.232213:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147363072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.232264:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147363072:12345-0@lo:400:kworker.0 Request processed in 52us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592873.232270:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788592873.232290:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788592873.232295:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592873.232308:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362688 00000100:00100000:1.0:1788592873.232399:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362688 00000100:00100000:3.0:1788592873.232407:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147363072:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.232436:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788592873.232444:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147362688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.232503:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147362688:12345-0@lo:400:kworker.0 Request processed in 60us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592873.232511:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788592873.232635:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147362560 00000100:00100000:2.0:1788592873.232641:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147362560 00000100:00100000:3.0:1788592873.232836:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147362688:0@lo:400:kworker.0 00000100:00100000:2.0:1788592873.232872:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788592873.232886:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3286:x1875475147362560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788592873.233030:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3286:x1875475147362560:12345-0@lo:400:kworker.0 Request processed in 150us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592873.233038:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788592873.235954:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898087920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147362560:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.237747:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3283:1875475147362944:0@lo:400:kworker.0 00000100:00100000:1.0:1788592873.237770:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875475147362816:0@lo:400:kworker.0 00000001:00100000:1.0:1788592873.293178:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9535983c-d4f6-45d9-9ca5-ac83e3a6e841 00000001:00100000:1.0:1788592873.293194:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf 00000001:00100000:2.0:1788592873.313684:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9535983c-d4f6-45d9-9ca5-ac83e3a6e841 00010000:00010000:2.0:1788592873.346985:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788592873.396201:0:16319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788592874.367251:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592875.396036:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592876.003965:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.004016:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.004050:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592876.004250:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887680 00000100:00100000:2.0:1788592876.004262:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887680 00000100:00100000:2.0:1788592876.004323:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:2.0:1788592876.004334:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:2341:x1875475136887680:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592876.004445:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:2341:x1875475136887680:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 113us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592876.004454:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 106 00000100:00100000:3.0:1788592876.004995:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.005060:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.005172:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.005202:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592876.005228:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888192 00000100:00100000:3.0:1788592876.005233:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888192 00000100:00100000:3.0:1788592876.005280:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887808 00000100:00100000:3.0:1788592876.005284:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887808 00000100:00100000:3.0:1788592876.005307:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592876.005316:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2341:x1875475136888192:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592876.005387:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2341:x1875475136888192:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 72us (1336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592876.005395:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:3.0:1788592876.005410:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592876.005416:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2341:x1875475136887808:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592876.005441:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2341:x1875475136887808:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 25us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592876.005447:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:3.0:1788592876.005468:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136887936 00000100:00100000:3.0:1788592876.005472:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136887936 00000100:00100000:3.0:1788592876.005493:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888448 00000100:00100000:3.0:1788592876.005496:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888448 00000100:00100000:3.0:1788592876.005509:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888064 00000100:00100000:3.0:1788592876.005512:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888064 00000100:00100000:3.0:1788592876.005523:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888320 00000100:00100000:3.0:1788592876.005525:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888320 00000100:00100000:3.0:1788592876.005539:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1788592876.005546:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2341:x1875475136887936:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592876.005656:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592876.005666:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2341:x1875475136888448:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592876.005768:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2341:x1875475136888448:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 104us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592876.005775:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592876.005789:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592876.005803:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2341:x1875475136888064:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592876.005824:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2341:x1875475136888064:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 22us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592876.005830:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592876.005850:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592876.005857:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2341:x1875475136888320:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592876.005876:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898087922d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2341:x1875475136888320:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 20us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592876.005882:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1788592876.005996:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc784a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2341:x1875475136887936:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 450us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592876.006009:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00080000:3.0:1788592876.006031:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788592876.006036:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788592876.006038:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788592876.424396:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788592877.209038:0:16467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6dc652a0 20000000:00000080:3.0:1788592877.209084:0:16467:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff898087927c00 uarg=0000000000000000 20000000:01000000:3.0:1788592877.209132:0:16467:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592877.209140:0:16467:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788592877.209147:0:16467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788592877.214403:0:16468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788592877.217953:0:16467:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788592877.227488:0:16467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788592877.227555:0:16467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227579:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b11 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227588:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227595:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511c92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227605:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227612:0:16467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227621:0:16467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.227986:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.228004:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 12 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.228021:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363200:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592877.228159:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.228190:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.228199:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363328:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592877.228233:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.228242:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 18 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.228251:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363456:0@lo:104: 00000100:00100000:0.0:1788592877.228291:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592877.228408:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.228417:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.228425:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363584:0@lo:104: 00000100:00100000:0.0:1788592877.228443:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788592877.231074:0:16467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.231095:0:16467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 18 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.231111:0:16467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363712:0@lo:104: 00000100:00100000:0.0:1788592877.231190:0:16467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592877.232863:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363456 00000100:00100000:3.0:1788592877.232879:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363456 00000100:00100000:3.0:1788592877.232997:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363584 00000100:00100000:3.0:1788592877.233002:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363584 00000100:00100000:3.0:1788592877.233023:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592877.233034:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+4:16467:x1875475147363456:12345-0@lo:104: 00010000:00010000:3.0:1788592877.233064:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233151:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788592877.233157:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+4:16467:x1875475147363456:12345-0@lo:104: Request processed in 126us (4866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592877.233164:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788592877.233181:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788592877.233187:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+3:16467:x1875475147363584:12345-0@lo:104: 00010000:00010000:3.0:1788592877.233196:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233234:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788592877.233252:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+3:16467:x1875475147363584:12345-0@lo:104: Request processed in 66us (4808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592877.233259:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788592877.233298:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788592877.233306:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233314:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4400 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592877.233319:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233328:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592877.233336:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592877.233342:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592877.233408:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233415:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592877.233438:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233446:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981885f4400/0x27b316f132511c92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511c99 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233458:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592877.233461:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233477:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981885f4200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592877.233480:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233486:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592877.233492:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592877.233497:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592877.233513:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233719:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592877.233740:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233748:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981885f4200/0x27b316f132511b5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b65 expref: -99 pid: 15036 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.233757:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592877.233758:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592877.233760:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788592877.233766:0:16467:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112d300 going to sleep for 11 seconds 00000100:00100000:0.0:1788592877.233790:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e51500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363456:0@lo:104: 00000100:00100000:0.0:1788592877.233800:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e50380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363584:0@lo:104: 00010000:00010000:3.0:1788592877.233868:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592877.233894:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147363840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592877.233937:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592877.233951:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363712 00000100:00100000:2.0:1788592877.233957:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363712 00000100:00100000:3.0:1788592877.233980:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147363968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592877.234012:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592877.234065:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363840 00000100:00100000:2.0:1788592877.234070:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363840 00010000:00010000:2.0:1788592877.234092:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 19 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592877.234133:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147363968 00000100:00100000:2.0:1788592877.234136:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147363968 00000100:00100000:0.0:1788592877.234223:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592877.234234:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+20:3286:x1875475147363840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592877.234247:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592877.234254:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 20 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.234265:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 20 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.234282:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccae00/0x27b316f132511c99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511c92 expref: 20 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.234300:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592877.234330:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3286:x1875475147363840:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592877.234337:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788592877.234413:0:14389:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788592877.234431:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592877.234439:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898182c53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:16467:x1875475147363712:12345-0@lo:104: 00010000:00010000:0.0:1788592877.234447:0:14389:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.234485:0:14389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788592877.234490:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898182c53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7e8219ee-ba92-4a43-886c-289e43c7369c+3:16467:x1875475147363712:12345-0@lo:104: Request processed in 53us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592877.234505:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592877.234569:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e52300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363712:0@lo:104: 00000100:00100000:3.0:1788592877.234597:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147363840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788592877.234621:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592877.234627:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.234633:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc1d13c20) 10000000:00010000:3.0:1788592877.234648:0:14343:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.234656:0:14343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788592877.234663:0:14343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788592877.234668:0:14343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788592877.234699:0:14343:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.234706:0:14343:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788592877.234721:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.234728:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.120@tcp lock: ffff8981bcccb200/0x27b316f132511b11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x27b316f132511b18 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.234743:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592877.234745:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592877.234747:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592877.234762:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147364096:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592877.234775:0:14340:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592877.234803:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592877.234811:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+18:3283:x1875475147363968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788592877.234819:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592877.234824:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592877.234832:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592877.234843:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e8000/0x27b316f132511b65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511b5e expref: 18 pid: 14347 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592877.234852:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592877.234882:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:3283:x1875475147363968:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592877.234888:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788592877.234920:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147363968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788592877.234957:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592877.235224:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364096 00000100:00100000:0.0:1788592877.235229:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364096 00010000:00010000:0.0:1788592877.235248:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 17 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592877.235261:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592877.235266:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888576 00000100:00100000:0.0:1788592877.235269:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888576 00010000:00010000:0.0:1788592877.235282:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592877.235295:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788592877.235301:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89818819a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+17:3284:x1875475147364096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788592877.235309:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592877.235312:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 17 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.235320:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 17 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.235331:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981c20e8a00/0x27b316f132511b18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x27b316f132511b11 expref: 17 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592877.235340:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788592877.235406:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bd15e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363200:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592877.235418:0:16467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e53b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16467:1875475147363328:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592877.235447:0:16467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592877.235597:0:14340:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788592877.235605:0:14340:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788592877.236744:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1788592877.236758:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:2344:x1875475136888576:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592877.236783:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592877.236790:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.236804:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.236819:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981988bfe00/0x27b316f132511df7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e17 expref: 13 pid: 14349 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.236831:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592877.236881:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:2344:x1875475136888576:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 127us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592877.236889:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1788592877.236939:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7e8219ee-ba92-4a43-886c-289e43c7369c:3284:1875475147364096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788592877.237450:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89818819a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3284:x1875475147364096:12345-0@lo:103:ldlm_bl.0 Request processed in 1320us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592877.237460:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788592877.248979:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592877.249332:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888704 00000100:00100000:3.0:1788592877.249343:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888704 00010000:00010000:3.0:1788592877.249441:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592877.249481:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:3.0:1788592877.249492:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:2344:x1875475136888704:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592877.249537:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592877.249544:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249558:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249579:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff898086a04e00/0x27b316f132511dbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1db5 expref: 12 pid: 14350 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249596:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249605:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249622:0:14342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249630:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249648:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249656:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249662:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592877.249666:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249684:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249701:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.249712:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592877.249784:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:2344:x1875475136888704:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 293us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592877.249793:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00010000:00010000:1.0:1788592877.250040:0:16467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592877.250060:0:16467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592877.250067:0:16467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8981bcccbc00/0x27b316f132511e21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592877.438627:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592877.824181:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788592877.824208:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147364224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788592877.824288:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592877.825459:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364224 00000100:00100000:1.0:1788592877.825469:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364224 00000100:00100000:1.0:1788592877.825545:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592877.825563:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147364224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592877.825614:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592877.825683:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147364224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592877.825691:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788592877.825748:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147364224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592877.827759:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788592878.015970:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788592878.335858:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147364608:0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.335937:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592878.335999:0:3284:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788592878.336002:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147364352:0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.336005:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147364480:0@lo:400:kworker.0 00000100:00100000:0.0:1788592878.336054:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592878.336082:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147364864:0@lo:400:kworker.0 00000100:00100000:0.0:1788592878.336107:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592878.336109:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592878.336127:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592878.336133:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147364736:0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.336139:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364608 00000100:00100000:3.0:1788592878.336147:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364608 00000100:00100000:0.0:1788592878.336155:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592878.336242:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364480 00000100:00100000:1.0:1788592878.336247:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364480 00000100:00100000:1.0:1788592878.336304:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788592878.336315:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147364480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.336337:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364864 00000100:00100000:3.0:1788592878.336343:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364864 00000100:00100000:3.0:1788592878.336388:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364736 00000100:00100000:3.0:1788592878.336391:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364736 00000100:00100000:3.0:1788592878.336408:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592878.336416:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147364608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592878.336445:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3284:x1875475147364480:12345-0@lo:400:kworker.0 Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592878.336455:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788592878.336462:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147364608:12345-0@lo:400:kworker.0 Request processed in 46us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.336470:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788592878.336500:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788592878.336506:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147364864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.336548:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147364864:12345-0@lo:400:kworker.0 Request processed in 42us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.336554:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788592878.336866:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147364992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788592878.336939:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592878.336975:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364352 00000100:00100000:2.0:1788592878.336980:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364352 00000100:00100000:2.0:1788592878.337011:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788592878.337019:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bd1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3286:x1875475147364352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592878.337038:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147364992 00000100:00100000:1.0:1788592878.337044:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147364992 00000100:00100000:1.0:1788592878.337074:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788592878.337080:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147364992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788592878.337112:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592878.337155:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147364992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592878.337162:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788592878.337179:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592878.337190:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147364736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788592878.337217:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147364992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592878.337233:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1875475147364736:12345-0@lo:400:kworker.0 Request processed in 45us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.337242:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788592878.337292:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3284:1875475147364480:0@lo:400:kworker.0 00000100:00100000:3.0:1788592878.337307:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147364608:0@lo:400:kworker.0 00000100:00100000:2.0:1788592878.337827:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bd1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+16:3286:x1875475147364352:12345-0@lo:400:kworker.0 Request processed in 809us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592878.337835:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1788592878.340244:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788592878.340256:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592878.340319:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3286:1875475147364736:0@lo:400:kworker.0 00000100:00100000:0.0:1788592878.340335:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7e8219ee-ba92-4a43-886c-289e43c7369c:3286:1875475147364352:0@lo:400:kworker.0 00000100:00100000:0.0:1788592878.340346:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147364864:0@lo:400:kworker.0 00010000:00010000:2.0:1788592878.462711:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592878.893879:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592878.893922:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888832 00000100:00100000:2.0:1788592878.893934:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888832 00000100:00100000:2.0:1788592878.893992:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:2.0:1788592878.894002:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+11:13766:x1875475136888832:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592878.894035:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592878.894072:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff898086a04e00/0x27b316f132511e28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e48 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592878.894110:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff898086a04e00/0x27b316f132511e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e48 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592878.894123:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff898086a04e00/0x27b316f132511e28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e48 expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592878.894134:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04e00, rc 0) 00000100:00100000:2.0:1788592878.894196:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136888832:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 196us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592878.894202:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 108 00000100:00100000:2.0:1788592878.898742:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592878.898789:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136888960 00000100:00100000:2.0:1788592878.898805:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136888960 00000100:00100000:2.0:1788592878.898868:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:2.0:1788592878.898882:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136888960:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592878.900368:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136888960:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 1460us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592878.900384:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 109 00000100:00100000:1.0:1788592878.905090:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592878.905171:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889088 00000100:00100000:3.0:1788592878.905184:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889088 00000100:00100000:3.0:1788592878.905254:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:3.0:1788592878.905266:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136889088:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592878.905607:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136889088:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 340us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.905617:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 110 00000100:00100000:2.0:1788592878.915852:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592878.921847:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889216 00000100:00100000:3.0:1788592878.921863:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889216 00000100:00100000:3.0:1788592878.921930:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:3.0:1788592878.921941:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+12:13766:x1875475136889216:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788592878.921963:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592878.921997:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89819762ee00/0x27b316f132511e2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e4f expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592878.922046:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89819762ee00/0x27b316f132511e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e4f expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592878.922060:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89819762ee00/0x27b316f132511e2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e4f expref: 13 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592878.922071:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762ee00, rc 0) 00000100:00100000:3.0:1788592878.922154:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13766:x1875475136889216:12345-192.168.204.20@tcp:101:ll_cfg_requeue.0 Request processed in 215us (6318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.922161:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 111 00000100:00100000:3.0:1788592878.929008:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592878.931710:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889344 00000100:00100000:1.0:1788592878.931734:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889344 00000100:00100000:1.0:1788592878.931818:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:1.0:1788592878.931839:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13766:x1875475136889344:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592878.932256:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13766:x1875475136889344:12345-192.168.204.20@tcp:501:ll_cfg_requeue.0 Request processed in 418us (3261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592878.932265:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 112 00000100:00100000:3.0:1788592878.936601:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592878.936645:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889472 00000100:00100000:3.0:1788592878.936658:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889472 00000100:00100000:3.0:1788592878.936717:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 113 00000100:00100000:3.0:1788592878.936730:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13766:x1875475136889472:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788592878.937035:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:13766:x1875475136889472:12345-192.168.204.20@tcp:503:ll_cfg_requeue.0 Request processed in 307us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592878.937044:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 113 10000000:01000000:3.0:1788592879.039662:0:14352:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788592879.039674:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8981989b1000 from 10 10000000:01000000:3.0:1788592879.039682:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788592879.039752:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592879.039765:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592879.039794:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592879.039828:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788592879.039927:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592879.040022:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185c44180 going to sleep for 11 seconds 00000100:00100000:0.0:1788592879.040212:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365120 00000100:00100000:0.0:1788592879.040223:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365120 00000100:00100000:0.0:1788592879.040293:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788592879.040304:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+16:14352:x1875475147365120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592879.040322:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592879.040341:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981bcccac00/0x27b316f132511e3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511e36 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.040418:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981bcccac00/0x27b316f132511e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511e36 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.040433:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981bcccac00/0x27b316f132511e3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511e36 expref: 17 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.040445:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccac00, rc 0) 00000100:00100000:0.0:1788592879.040505:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592879.040513:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788592879.040572:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788592879.040592:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e3d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.040603:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511e3d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592879.040820:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788592879.040852:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592879.041724:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592879.045178:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365248 00000100:00100000:2.0:1788592879.045203:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365248 00000100:00100000:2.0:1788592879.045287:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788592879.045299:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.045736:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 438us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592879.045745:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788592879.046072:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e50700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.046137:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.046214:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592879.046260:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788592879.050848:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365376 00000100:00100000:2.0:1788592879.050874:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365376 00000100:00100000:2.0:1788592879.050958:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788592879.051054:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.051431:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 462us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592879.051440:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788592879.051469:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592879.054533:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788592879.055534:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788592879.055575:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788592879.055592:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e3d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.055607:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff89819762f400/0x27b316f132511e36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e3d expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788592879.055619:0:14352:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788592879.055622:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff89819718b800 from 10 10000000:01000000:0.0:1788592879.055625:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788592879.055700:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.055710:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592879.055738:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592879.055771:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788592879.055861:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592879.055909:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788592879.057793:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365504 00000100:00100000:2.0:1788592879.057810:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365504 00000100:00100000:2.0:1788592879.057889:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788592879.057900:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+17:14352:x1875475147365504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592879.057940:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592879.057965:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff898086a04600/0x27b316f132511e4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511e44 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592879.058025:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff898086a04600/0x27b316f132511e4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511e44 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592879.058040:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff898086a04600/0x27b316f132511e4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511e44 expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592879.058054:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04600, rc 0) 00000100:00100000:2.0:1788592879.058153:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592879.058160:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788592879.058227:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788592879.058250:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e4b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592879.058262:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511e4b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592879.058378:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.058421:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592879.058456:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898191155c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592879.058470:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365632 00000100:00100000:2.0:1788592879.058474:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365632 00000100:00100000:2.0:1788592879.058498:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788592879.058505:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.058836:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592879.058844:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788592879.058875:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.058911:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bf4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.058957:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592879.058972:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898191155c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788592879.058984:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365760 00000100:00100000:2.0:1788592879.058988:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365760 00000100:00100000:2.0:1788592879.059006:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788592879.059026:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788592879.059186:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592879.059193:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788592879.059229:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bf4a9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788592879.080832:0:16539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788592879.081066:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788592879.081095:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592879.081114:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e4b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081129:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981bcccb800/0x27b316f132511e44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e4b expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788592879.081142:0:14352:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788592879.081145:0:14352:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8981c0d8e000 from 10 10000000:01000000:1.0:1788592879.081148:0:14352:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788592879.081222:0:14352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081231:0:14352:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081245:0:14352:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592879.081300:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.081425:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592879.081478:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592879.081505:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147365888 00000100:00100000:1.0:1788592879.081515:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147365888 00000100:00100000:1.0:1788592879.081575:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788592879.081586:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+18:14352:x1875475147365888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592879.081604:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592879.081621:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8981988bfa00/0x27b316f132511e59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x27b316f132511e52 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081935:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8981988bfa00/0x27b316f132511e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x27b316f132511e52 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081952:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8981988bfa00/0x27b316f132511e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x27b316f132511e52 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.081965:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bfa00, rc 0) 00000100:00100000:1.0:1788592879.082028:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147365888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 444us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592879.082036:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788592879.082105:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147365888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788592879.082123:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e59 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.082133:0:14352:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x27b316f132511e59 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592879.082472:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147366016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.082502:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592879.082520:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592879.082536:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147366016 00000100:00100000:1.0:1788592879.082540:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147366016 00000100:00100000:1.0:1788592879.082577:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592879.082584:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147366016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.082941:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc91d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147366016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592879.082949:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788592879.082980:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147366016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.083024:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147366144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.083077:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592879.083092:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592879.083104:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147366144 00000100:00100000:1.0:1788592879.083107:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147366144 00000100:00100000:1.0:1788592879.083127:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788592879.083133:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147366144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788592879.085389:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:14352:x1875475147366144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2217us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592879.085406:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788592879.085504:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e5a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7e8219ee-ba92-4a43-886c-289e43c7369c:14352:1875475147366144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788592879.089260:0:16540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788592879.089456:0:14352:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788592879.089484:0:14352:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788592879.089499:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e59 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592879.089531:0:14352:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.120@tcp lock: ffff8981988be800/0x27b316f132511e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x27b316f132511e59 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592879.487090:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788592880.518005:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788592881.113782:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.114060:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889600 00000100:00100000:3.0:1788592881.114074:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889600 00000100:00100000:3.0:1788592881.114176:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592881.114189:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:14425:x1875475136889600:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592881.114217:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.114250:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e56 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114336:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114377:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114396:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114412:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114439:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.114446:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788592881.114862:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592881.115131:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e200/0x27b316f132511e75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115143:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e200/0x27b316f132511e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115151:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e200/0x27b316f132511e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592881.115183:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788592881.115187:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788592881.115229:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e200/0x27b316f132511e75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115241:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115248:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115255:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115261:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.115266:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115283:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115298:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:3.0:1788592881.115301:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.115307:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115315:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115333:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115339:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115344:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115487:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.115490:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115496:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115503:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8981a03dee00) 00010000:00010000:3.0:1788592881.115505:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.115508:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115523:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115566:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e56 expref: 8 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115580:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e200/0x27b316f132511e75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e56 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.115587:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8981a03de000) 00010000:00010000:3.0:1788592881.115589:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788592881.115592:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e200, rc 0) 00000100:00100000:3.0:1788592881.115684:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:14425:x1875475136889600:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1497us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.115693:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592881.125472:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.125561:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.125673:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.125714:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.125731:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.125750:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592881.125837:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890240 00000100:00100000:2.0:1788592881.125851:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890240 00000100:00100000:2.0:1788592881.125951:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890496 00000100:00100000:2.0:1788592881.125954:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890496 00000100:00100000:2.0:1788592881.125981:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890112 00000100:00100000:2.0:1788592881.125984:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890112 00000100:00100000:2.0:1788592881.126006:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592881.126017:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2342:x1875475136890240:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592881.126110:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2342:x1875475136890240:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 95us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.126136:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592881.126155:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1788592881.126162:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2342:x1875475136890496:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592881.126189:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2342:x1875475136890496:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.126195:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1788592881.126218:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:2.0:1788592881.126225:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2342:x1875475136890112:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592881.126250:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2342:x1875475136890112:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 26us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.126256:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00080000:2.0:1788592881.126281:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788592881.126285:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592881.128105:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889984 00000100:00100000:1.0:1788592881.128125:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889984 00000100:00100000:1.0:1788592881.128228:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:1.0:1788592881.128239:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:2342:x1875475136889984:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:1.0:1788592881.128329:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:92e91180-c6da-4b6e-8b51-7ef4ca1db3b6+13:2342:x1875475136889984:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 92us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.128336:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1788592881.130719:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592881.130919:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890624 00000100:00100000:2.0:1788592881.130932:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890624 00000100:00100000:2.0:1788592881.131039:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1788592881.131051:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2342:x1875475136890624:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:2.0:1788592881.131137:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2342:x1875475136890624:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.131145:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00080000:3.0:1788592881.131745:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788592881.133377:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136889856 00000100:00100000:0.0:1788592881.133395:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136889856 00000100:00100000:0.0:1788592881.133488:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890368 00000100:00100000:0.0:1788592881.133492:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890368 00000100:00100000:0.0:1788592881.133647:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592881.133660:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592881.133662:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2342:x1875475136890368:12345-192.168.204.20@tcp:400:kworker.0 00000100:00100000:3.0:1788592881.133676:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:14425:x1875475136889856:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788592881.133692:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.133740:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511e7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e5d expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592881.133778:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2342:x1875475136890368:12345-192.168.204.20@tcp:400:kworker.0 Request processed in 120us (8025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.133787:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00010000:00010000:3.0:1788592881.133833:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.133851:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.133864:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.134834:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.134851:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.134860:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.135463:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e600/0x27b316f132511e91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.135476:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e600/0x27b316f132511e91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.135483:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e600/0x27b316f132511e91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592881.135496:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788592881.136424:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136451:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136459:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136466:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.136471:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136480:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136500:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8981a03de000) 00010000:00010000:3.0:1788592881.136504:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.136510:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136517:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511e83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136532:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136538:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136544:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136549:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.136558:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.136565:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.137425:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8981a03dee00) 00010000:00010000:3.0:1788592881.137429:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.137437:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.137443:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511e8a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788592881.137603:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592881.141456:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511e7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e5d expref: 10 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.141495:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762e600/0x27b316f132511e91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e5d expref: 9 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.141505:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981a03de600) 00010000:00010000:3.0:1788592881.141509:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.141514:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762e600, rc 0) 00000100:00100000:3.0:1788592881.142473:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14425:x1875475136889856:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 8794us (17121us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788592881.142487:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:2.0:1788592881.160542:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.160669:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890752 00000100:00100000:0.0:1788592881.160683:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890752 00000100:00100000:0.0:1788592881.160766:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1788592881.160778:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14425:x1875475136890752:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788592881.160924:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14425:x1875475136890752:12345-192.168.204.20@tcp:59:lhsmtool_posix.0 Request processed in 148us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.160933:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:1.0:1788592881.176388:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.176535:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136890880 00000100:00100000:0.0:1788592881.176549:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136890880 00000100:00100000:0.0:1788592881.176623:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1788592881.176634:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14431:x1875475136890880:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592881.176662:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.176691:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511e9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e64 expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176787:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176804:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176819:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176836:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176844:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.176851:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178157:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178177:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178198:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178204:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.178209:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178219:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178237:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:0.0:1788592881.178242:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.178247:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178254:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ea6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178270:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178276:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178281:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178286:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.178288:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178303:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178311:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff898185c2d100) 00010000:00010000:0.0:1788592881.178313:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.178316:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178320:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511ead lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178415:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511e9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e64 expref: 10 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178427:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:0.0:1788592881.178430:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.178433:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511e9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e64 expref: 10 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.178443:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592881.178532:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14431:x1875475136890880:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 1898us (2189us total) trans 0 rc 301/301 00000100:00100000:0.0:1788592881.178542:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1788592881.183316:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.183643:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891008 00000100:00100000:3.0:1788592881.183656:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891008 00000100:00100000:3.0:1788592881.183730:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1788592881.183741:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14431:x1875475136891008:12345-192.168.204.20@tcp:700:lfs.0 00000100:00100000:3.0:1788592881.184155:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14431:x1875475136891008:12345-192.168.204.20@tcp:700:lfs.0 Request processed in 414us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.184165:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592881.192377:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.192512:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891264 00000100:00100000:0.0:1788592881.192524:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891264 00000100:00100000:0.0:1788592881.192609:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:0.0:1788592881.192621:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14431:x1875475136891264:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1788592881.192732:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592881.192776:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511de2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ddf expref: 9 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.192799:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:0.0:1788592881.192806:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592881.193311:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.193329:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.193338:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.193437:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 5 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.193453:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 5 pid: 14354 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592881.193471:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875475147366272:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592881.193599:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788592881.197017:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e53100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14356:1875475147366272:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592881.197059:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.199550:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.201785:0:16469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891392 00000100:00100000:3.0:1788592881.201806:0:16469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891392 00010000:00010000:3.0:1788592881.201938:0:16469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 6 pid: 14354 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.202195:0:16469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1788592881.202208:0:16469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:2343:x1875475136891392:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592881.202229:0:16469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592881.202237:0:16469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 6 pid: 14354 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202256:0:16469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 6 pid: 14354 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202285:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511e1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e41 expref: 6 pid: 14354 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202307:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:3.0:1788592881.202313:0:16469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202326:0:16469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202335:0:16469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.202418:0:16469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592881.202500:0:16469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:2343:x1875475136891392:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 294us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.202508:0:16469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00010000:00010000:1.0:1788592881.202828:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.202840:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.202873:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.202886:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.202896:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592881.204471:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788592881.204493:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204504:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204513:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204519:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccae00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592881.204524:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204534:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204553:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592881.204557:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592881.204562:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.204569:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511eb4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592881.204592:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef47c5ef reply state 000000000a938d3d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.204602:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592881.204728:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+10:14431:x1875475136891264:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 12105us (12380us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788592881.204748:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00010000:00010000:3.0:1788592881.209333:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209451:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209460:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209467:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.209472:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209482:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209502:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89818289ae00) 00010000:00010000:3.0:1788592881.209505:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.209512:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.209519:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511ebb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.325771:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.325896:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891520 00000100:00100000:0.0:1788592881.325926:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891520 00000100:00100000:0.0:1788592881.326078:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:0.0:1788592881.326091:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:14439:x1875475136891520:12345-192.168.204.20@tcp:101:lctl.0 00010000:00010000:0.0:1788592881.326124:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.326154:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e6b expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326241:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511ec9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326258:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326287:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.326335:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592881.326339:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592881.326431:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511ec9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326461:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e6b expref: 11 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326486:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccae00/0x27b316f132511ec9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e6b expref: 10 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.326496:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592881.326499:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592881.326503:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccae00, rc 0) 00000100:00100000:0.0:1788592881.326585:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+10:14439:x1875475136891520:12345-192.168.204.20@tcp:101:lctl.0 Request processed in 496us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.326593:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 20 00000100:00100000:2.0:1788592881.351021:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.352919:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891648 00000100:00100000:0.0:1788592881.352943:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891648 00000100:00100000:2.0:1788592881.353384:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:2.0:1788592881.353407:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+5:14440:x1875475136891648:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:2.0:1788592881.353438:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592881.353471:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e72 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353556:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05200/0x27b316f132511ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353587:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05200/0x27b316f132511ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353605:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05200/0x27b316f132511ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592881.353666:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788592881.353669:0:14355:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592881.353695:0:14355:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05200/0x27b316f132511ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353727:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e72 expref: 7 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353763:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05200/0x27b316f132511ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e72 expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.353774:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:2.0:1788592881.353794:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788592881.353800:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a05200, rc 0) 00000100:00100000:2.0:1788592881.353904:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:14440:x1875475136891648:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 508us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.353912:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 21 00000100:00100000:1.0:1788592881.358157:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.358268:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136891776 00000100:00100000:0.0:1788592881.358281:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136891776 00000100:00100000:0.0:1788592881.358377:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:0.0:1788592881.358388:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+6:14440:x1875475136891776:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592881.358415:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.358442:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ede lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e79 expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358525:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358543:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358557:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358583:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358591:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358597:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358735:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358756:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358763:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.358801:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592881.358805:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592881.358839:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358853:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358861:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358868:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358874:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.358878:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358886:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358899:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:0.0:1788592881.358908:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.358914:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358921:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358944:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358950:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358955:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358961:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.358974:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358981:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.358988:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff898185c2d200) 00010000:00010000:0.0:1788592881.358992:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.358995:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.359000:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511eec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.359042:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ede lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e79 expref: 8 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.359070:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e79 expref: 7 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.359077:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592881.359080:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592881.359083:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bccca400, rc 0) 00000100:00100000:0.0:1788592881.359160:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+7:14440:x1875475136891776:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 773us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.359169:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 22 00000100:00100000:3.0:1788592881.363035:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.363266:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136892032 00000100:00100000:1.0:1788592881.363278:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136892032 00000100:00100000:1.0:1788592881.363465:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:1.0:1788592881.363479:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+7:14440:x1875475136892032:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:1.0:1788592881.363508:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592881.363534:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511efa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e80 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592881.363667:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788592881.363854:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511efa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e80 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.363873:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:1.0:1788592881.363876:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592881.363882:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511efa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e80 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.363899:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf000, rc 0) 00000100:00100000:1.0:1788592881.363984:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+8:14440:x1875475136892032:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 508us (964us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788592881.363992:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 23 00000100:00100000:2.0:1788592881.369098:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.369232:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136892288 00000100:00100000:0.0:1788592881.369245:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136892288 00000100:00100000:0.0:1788592881.369314:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:0.0:1788592881.369326:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+8:14440:x1875475136892288:12345-192.168.204.20@tcp:36:lfs.0 00010000:00010000:0.0:1788592881.369429:0:15998:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592881.369460:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ef3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e79 expref: 8 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.369481:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592881.369493:0:15998:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788592881.369522:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.369536:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.369548:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592881.369867:0:15998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee2f71c1 reply state 0000000046467c63 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592881.369878:0:15998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788592881.369887:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788592881.370122:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+9:14440:x1875475136892288:12345-192.168.204.20@tcp:36:lfs.0 Request processed in 677us (917us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788592881.370133:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 24 00000100:00100000:3.0:1788592881.375159:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.375280:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136892544 00000100:00100000:1.0:1788592881.375294:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136892544 00000100:00100000:1.0:1788592881.375386:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1788592881.375397:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+9:14440:x1875475136892544:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592881.375972:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+10:14440:x1875475136892544:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 565us (815us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788592881.375983:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:2.0:1788592881.380120:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.380267:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136892800 00000100:00100000:3.0:1788592881.380281:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136892800 00000100:00100000:3.0:1788592881.380390:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:3.0:1788592881.380402:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+10:14440:x1875475136892800:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592881.380544:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.380632:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e87 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381073:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381094:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381109:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381126:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381133:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.381140:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592881.381293:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788592881.382613:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383086:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383101:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383110:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383117:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.383122:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383132:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383153:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2d200) 00010000:00010000:0.0:1788592881.383157:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788592881.383163:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.383169:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f08 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383552:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383566:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383571:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.383573:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383580:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383591:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592881.383594:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.383597:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383604:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762ec00/0x27b316f132511f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383621:0:14355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383628:0:14355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383634:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383639:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:3.0:1788592881.383643:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383659:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383669:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8981a03dee00) 00010000:00010000:3.0:1788592881.383671:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788592881.383674:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.383680:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.384104:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e87 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.384119:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592881.384123:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592881.384127:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e87 expref: 11 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.384138:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762f200, rc 0) 00000100:00100000:3.0:1788592881.384235:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+10:14440:x1875475136892800:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 3834us (4127us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788592881.384246:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 25 00000100:00100000:2.0:1788592881.390874:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.391012:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136892928 00000100:00100000:0.0:1788592881.391026:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136892928 00000100:00100000:0.0:1788592881.391098:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:0.0:1788592881.391109:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+10:14440:x1875475136892928:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:0.0:1788592881.391140:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.391170:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f2b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e8e expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391284:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391303:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391317:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.391385:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788592881.391389:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592881.391420:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391458:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f2b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 12 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391479:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 11 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.391488:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592881.391507:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788592881.391513:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb200, rc 0) 00000100:00100000:0.0:1788592881.391597:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+11:14440:x1875475136892928:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 491us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.391605:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 26 00000100:00100000:2.0:1788592881.400687:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.400839:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893056 00000100:00100000:1.0:1788592881.400852:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893056 00000100:00100000:1.0:1788592881.400924:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:1.0:1788592881.400937:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+11:14440:x1875475136893056:12345-192.168.204.20@tcp:37:lfs.0 00000100:00100000:1.0:1788592881.407272:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+11:14440:x1875475136893056:12345-192.168.204.20@tcp:37:lfs.0 Request processed in 6319us (6581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.407289:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:2.0:1788592881.411318:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.411615:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893312 00000100:00100000:3.0:1788592881.411633:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893312 00000100:00100000:2.0:1788592881.411933:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1788592881.411948:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89819117dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+11:14440:x1875475136893312:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:2.0:1788592881.412291:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89819117dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+12:14440:x1875475136893312:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 346us (986us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788592881.412300:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:2.0:1788592881.460107:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.460232:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893440 00000100:00100000:1.0:1788592881.460245:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893440 00000100:00100000:1.0:1788592881.460313:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:1.0:1788592881.460324:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+10:14446:x1875475136893440:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592881.460392:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592881.460659:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05400/0x27b316f132511f39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e95 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460742:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460759:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460774:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460811:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460919:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.460927:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461055:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05000/0x27b316f132511f4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461065:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05000/0x27b316f132511f4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461073:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05000/0x27b316f132511f4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592881.461106:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788592881.461110:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788592881.461155:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05000/0x27b316f132511f4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461170:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461179:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461187:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461204:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a04000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592881.461210:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461219:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461234:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:2.0:1788592881.461237:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592881.461242:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461248:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04000/0x27b316f132511f40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461263:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461269:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461275:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461279:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592881.461282:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461287:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461306:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8981906ae200) 00010000:00010000:2.0:1788592881.461309:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592881.461312:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461319:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05c00/0x27b316f132511f47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461530:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05400/0x27b316f132511f39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e95 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461548:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05000/0x27b316f132511f4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e95 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.461556:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:2.0:1788592881.461559:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788592881.461684:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a05000, rc 0) 00000100:00100000:2.0:1788592881.461776:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+11:14446:x1875475136893440:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1453us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.461786:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 27 00000100:00100000:3.0:1788592881.465617:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.465829:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893696 00000100:00100000:1.0:1788592881.465845:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893696 00000100:00100000:1.0:1788592881.465919:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 28 00000100:00100000:1.0:1788592881.465932:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+11:14446:x1875475136893696:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1788592881.465999:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592881.466028:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132511f55 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1e9c expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.466185:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.466222:0:15998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 11 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.466234:0:15998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.466279:0:15998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 11 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.466296:0:15998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 11 pid: 15998 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.466312:0:15998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147366400:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592881.466660:0:15998:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.471914:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.473044:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893824 00000100:00100000:3.0:1788592881.473059:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893824 00010000:00010000:3.0:1788592881.473136:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 12 pid: 15998 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.473193:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1788592881.473206:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+12:2344:x1875475136893824:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592881.473228:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592881.473237:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 12 pid: 15998 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.473255:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 12 pid: 15998 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.473286:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:3.0:1788592881.473293:0:14342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.473307:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.473318:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.473346:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592881.473588:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9535983c-d4f6-45d9-9ca5-ac83e3a6e841+12:2344:x1875475136893824:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 383us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592881.473597:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00010000:00010000:0.0:1788592881.473819:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e8e expref: 11 pid: 15998 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592881.473841:0:15998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147366400:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592881.473873:0:15998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.473884:0:15998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.473890:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.473921:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.473931:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.473940:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476534:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476571:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476601:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.476616:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592881.476665:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476674:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476682:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476688:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf000 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592881.476693:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476701:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476718:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:0.0:1788592881.476722:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592881.476727:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476734:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf000/0x27b316f132511f5c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788592881.476752:0:15998:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009fe1d660 reply state 0000000077f97cb7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592881.476774:0:15998:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788592881.476825:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988be600/0x27b316f132511f55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 14 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476842:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 13 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.476850:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592881.476852:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788592881.476854:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccbc00, rc 0) 00000100:00100000:0.0:1788592881.476949:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14446:x1875475136893696:12345-192.168.204.20@tcp:101:bash.0 Request processed in 11020us (11348us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788592881.476959:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 28 00010000:00010000:2.0:1788592881.481224:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481242:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481250:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481284:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592881.481290:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481299:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481319:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff898185c2d200) 00010000:00010000:2.0:1788592881.481322:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592881.481327:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.481334:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511f63 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.493008:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.494096:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136893952 00000100:00100000:0.0:1788592881.494112:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136893952 00000100:00100000:0.0:1788592881.494198:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:0.0:1788592881.494210:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+13:14446:x1875475136893952:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:0.0:1788592881.494243:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592881.494272:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f78 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ea3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494496:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494513:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494552:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.494722:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788592881.494727:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592881.494750:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494763:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494798:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511f78 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494975:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 14 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.494987:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592881.494991:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788592881.494996:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb000, rc 0) 00000100:00100000:0.0:1788592881.495089:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14446:x1875475136893952:12345-192.168.204.20@tcp:101:bash.0 Request processed in 881us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.495097:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 29 00000100:00100000:1.0:1788592881.499697:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.499913:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136894208 00000100:00100000:3.0:1788592881.499926:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136894208 00000100:00100000:3.0:1788592881.500005:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1788592881.500036:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14446:x1875475136894208:12345-192.168.204.20@tcp:35:bash.0 00000100:00100000:3.0:1788592881.500761:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+15:14446:x1875475136894208:12345-192.168.204.20@tcp:35:bash.0 Request processed in 723us (1074us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788592881.500770:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00010000:00010000:3.0:1788592881.534858:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788592881.594549:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.594835:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136894464 00000100:00100000:3.0:1788592881.594847:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136894464 00000100:00100000:3.0:1788592881.594926:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1788592881.594938:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+15:14456:x1875475136894464:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592881.594981:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.595009:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1eaa expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592881.595137:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788592881.595304:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eaa expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.595324:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff898185c2d100) 00010000:00010000:3.0:1788592881.595327:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788592881.595334:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eaa expref: 17 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.595397:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762f200, rc 0) 00000100:00100000:3.0:1788592881.595478:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+16:14456:x1875475136894464:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 541us (943us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788592881.595486:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 30 00000100:00100000:3.0:1788592881.603432:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.603849:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136894720 00000100:00100000:1.0:1788592881.603863:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136894720 00000100:00100000:1.0:1788592881.603940:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592881.603952:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+16:14456:x1875475136894720:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592881.604286:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+17:14456:x1875475136894720:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 334us (866us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788592881.604295:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:1.0:1788592881.647559:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.647918:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136894976 00000100:00100000:3.0:1788592881.647931:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136894976 00000100:00100000:3.0:1788592881.648016:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1788592881.648028:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+17:14459:x1875475136894976:12345-192.168.204.20@tcp:101:lfs.0 00010000:00010000:3.0:1788592881.648066:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788592881.648096:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1eb1 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.648228:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.648247:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.648262:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788592881.648275:0:14355:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788592881.648618:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762f200/0x27b316f132511f94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb1 expref: 20 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.648898:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb1 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592881.648908:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:3.0:1788592881.648912:0:14355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788592881.648916:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89819762fc00, rc 0) 00000100:00100000:3.0:1788592881.649016:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:14459:x1875475136894976:12345-192.168.204.20@tcp:101:lfs.0 Request processed in 990us (1472us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788592881.649042:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 31 00000100:00100000:3.0:1788592881.653288:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.653397:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.653678:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136895104 00000100:00100000:1.0:1788592881.653691:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136895104 00000100:00100000:1.0:1788592881.653777:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:1.0:1788592881.653788:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:14459:x1875475136895104:12345-192.168.204.20@tcp:54:lfs.0 00010000:00010000:1.0:1788592881.653892:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653914:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653930:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653972:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653980:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653986:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.653992:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592881.653997:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.654006:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.654020:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:1.0:1788592881.654023:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788592881.654029:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.654047:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132511fa9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.654145:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:14459:x1875475136895104:12345-192.168.204.20@tcp:54:lfs.0 Request processed in 359us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592881.654154:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 32 00000100:00100000:2.0:1788592881.655339:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136895232 00000100:00100000:2.0:1788592881.655384:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136895232 00000100:00100000:2.0:1788592881.655468:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592881.655479:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:2342:x1875475136895232:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592881.655500:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592881.655526:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89819762fc00/0x27b316f132511f9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb1 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.655542:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592881.655548:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592881.655631:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:2342:x1875475136895232:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 154us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.655652:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592881.660054:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.660175:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136895488 00000100:00100000:1.0:1788592881.660188:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136895488 00000100:00100000:1.0:1788592881.660257:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592881.660270:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:14459:x1875475136895488:12345-192.168.204.20@tcp:35:lfs.0 00000100:00100000:1.0:1788592881.660636:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:14459:x1875475136895488:12345-192.168.204.20@tcp:35:lfs.0 Request processed in 367us (597us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788592881.660645:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:0.0:1788592881.938613:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592881.939084:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136895744 00000100:00100000:2.0:1788592881.939097:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136895744 00000100:00100000:2.0:1788592881.939179:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:2.0:1788592881.939191:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+19:14490:x1875475136895744:12345-192.168.204.20@tcp:101:cat.0 00010000:00010000:2.0:1788592881.939226:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592881.939254:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132511fb0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1eb8 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.939419:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f132511fb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.939437:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f132511fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.939454:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f132511fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788592881.939467:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788592881.939653:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132511fb0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb8 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.939675:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f132511fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb8 expref: 21 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.939685:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592881.939687:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788592881.939709:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04800, rc 0) 00000100:00100000:2.0:1788592881.939860:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:14490:x1875475136895744:12345-192.168.204.20@tcp:101:cat.0 Request processed in 670us (1263us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788592881.939869:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 33 00000100:00100000:3.0:1788592881.944035:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.944085:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.944206:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136896128 00000100:00100000:1.0:1788592881.944218:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136896128 00000100:00100000:1.0:1788592881.944283:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:1.0:1788592881.944294:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:14490:x1875475136896128:12345-192.168.204.20@tcp:35:cat.0 00000100:00100000:1.0:1788592881.944737:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+22:14490:x1875475136896128:12345-192.168.204.20@tcp:35:cat.0 Request processed in 443us (715us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788592881.944745:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 8 00000100:00100000:2.0:1788592881.946020:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136895872 00000100:00100000:2.0:1788592881.946035:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136895872 00000100:00100000:2.0:1788592881.946149:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1788592881.946159:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+22:2341:x1875475136895872:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592881.946174:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592881.946204:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f132511fb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1eb8 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.946226:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592881.946233:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592881.946293:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:2341:x1875475136895872:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 135us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.946301:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1788592881.989025:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592881.989146:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136896384 00000100:00100000:1.0:1788592881.989160:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136896384 00000100:00100000:1.0:1788592881.989234:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:1.0:1788592881.989246:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:14496:x1875475136896384:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1788592881.989280:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592881.989325:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511fc5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ebf expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989498:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989518:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 22 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989527:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989536:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989595:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989611:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 22 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.989628:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875475147366528:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592881.989749:0:14354:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 22 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592881.989760:0:14354:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 22 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592881.989770:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875475147366656:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592881.989804:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788592881.992701:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875475147366528:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592881.992723:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14354:1875475147366656:192.168.204.20@tcp:104: 00010000:00010000:1.0:1788592881.992760:0:14354:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592881.993417:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592881.993526:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592881.994181:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136896512 00000100:00100000:2.0:1788592881.994193:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136896512 00010000:00010000:2.0:1788592881.994251:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 23 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.994301:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136896640 00000100:00100000:2.0:1788592881.994304:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136896640 00010000:00010000:2.0:1788592881.994319:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 24 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592881.994391:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:2.0:1788592881.994424:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898188199c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:2342:x1875475136896512:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592881.994444:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592881.994452:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 24 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.994466:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 24 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.994493:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511f6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1e9c expref: 24 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.994513:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592881.994519:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.994529:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592881.994536:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592881.994849:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 12 00000100:00100000:0.0:1788592881.994862:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:2342:x1875475136896640:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788592881.994870:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592881.994882:0:14340:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 23 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994905:0:14340:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 23 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994920:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511f7f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ea3 expref: 23 pid: 14356 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994931:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592881.994934:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994944:0:14340:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994962:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.994996:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592881.995053:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+22:2342:x1875475136896640:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 195us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592881.995061:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 12 00010000:00010000:0.0:1788592881.995094:0:14354:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.995102:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592881.995123:0:14354:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592881.995342:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f132511fc5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ebf expref: 23 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.995402:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf200/0x27b316f132511fcc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ebf expref: 22 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.995410:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592881.995413:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788592881.995416:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf200, rc 0) 00000100:00100000:0.0:1788592881.995441:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+22:14496:x1875475136896384:12345-192.168.204.20@tcp:101:dd.0 Request processed in 6198us (6430us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788592881.995448:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 34 00000100:00100000:2.0:1788592881.997224:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898188199c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:2342:x1875475136896512:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 2783us (3791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592881.997247:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:3.0:1788592881.998151:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592881.999364:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136896896 00000100:00100000:0.0:1788592881.999380:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136896896 00000100:00100000:0.0:1788592881.999450:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 35 00000100:00100000:0.0:1788592881.999462:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+21:14496:x1875475136896896:12345-192.168.204.20@tcp:36:dd.0 00010000:00010000:0.0:1788592881.999846:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.999868:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592881.999882:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592881.999941:0:14356:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788592881.999994:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d83e7697 reply state 00000000f799c75a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.000004:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788592882.000115:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14496:x1875475136896896:12345-192.168.204.20@tcp:36:dd.0 Request processed in 655us (1971us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788592882.000124:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 35 00000020:00080000:0.0:1788592882.000129:0:14356:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788592882.002013:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002036:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002044:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002050:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.002056:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002065:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002086:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592882.002089:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592882.002097:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.002104:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fda lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.003930:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.004346:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897024 00000100:00100000:1.0:1788592882.004391:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897024 00000100:00100000:1.0:1788592882.004463:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:1.0:1788592882.004476:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:14496:x1875475136897024:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:1.0:1788592882.004508:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592882.004537:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132511fe1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ec6 expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.004741:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132511fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ec6 expref: 24 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.004760:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132511fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ec6 expref: 24 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.004782:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:1.0:1788592882.004786:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592882.004790:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf800, rc 0) 00000100:00100000:1.0:1788592882.004922:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14496:x1875475136897024:12345-192.168.204.20@tcp:101:dd.0 Request processed in 448us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.004931:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 36 00000100:00100000:3.0:1788592882.019515:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.019691:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897280 00000100:00100000:0.0:1788592882.019704:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897280 00000100:00100000:0.0:1788592882.019787:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:0.0:1788592882.019863:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14496:x1875475136897280:12345-192.168.204.20@tcp:103:dd.0 00010000:00010000:0.0:1788592882.019903:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788592882.019937:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132511fe1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ec6 expref: 24 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.019973:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592882.019979:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788592882.020153:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:14496:x1875475136897280:12345-192.168.204.20@tcp:103:dd.0 Request processed in 355us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.020162:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:3.0:1788592882.022549:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.022757:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897408 00000100:00100000:0.0:1788592882.022770:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897408 00000100:00100000:0.0:1788592882.022914:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:0.0:1788592882.022927:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:14496:x1875475136897408:12345-192.168.204.20@tcp:58:dd.0 00010000:00010000:0.0:1788592882.023105:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.023127:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.023142:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788592882.024321:0:14356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788592882.026202:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788592882.026299:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788592882.026873:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:14496:x1875475136897408:12345-192.168.204.20@tcp:58:dd.0 Request processed in 3939us (4329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.026888:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 37 00000100:00100000:3.0:1788592882.029055:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.029122:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897536 00000100:00100000:0.0:1788592882.029134:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897536 00000100:00100000:0.0:1788592882.029201:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 38 00000100:00100000:0.0:1788592882.029212:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+23:14496:x1875475136897536:12345-192.168.204.20@tcp:101:dd.0 00010000:00010000:0.0:1788592882.029238:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592882.029264:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ecd expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029338:0:14354:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029365:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029385:0:14354:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029399:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029413:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592882.029416:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592882.029420:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 24 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.029429:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bcccb000, rc 0) 00000100:00100000:0.0:1788592882.029745:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14496:x1875475136897536:12345-192.168.204.20@tcp:101:dd.0 Request processed in 533us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.029753:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 38 00000040:00080000:2.0:1788592882.111724:0:14388:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788592882.111747:0:14388:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788592882.111793:0:14388:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788592882.111801:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788592882.111970:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14388:1875475147366784:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788592882.112142:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff89818b770840 going to sleep for 11 seconds 00000100:00100000:1.0:1788592882.117511:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.117664:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897664 00000100:00100000:3.0:1788592882.117679:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897664 00000100:00100000:3.0:1788592882.117759:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:3.0:1788592882.117772:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136897664:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788592882.117899:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136897664:12345-192.168.204.20@tcp:900:lhsmtool_posix.0 Request processed in 129us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592882.117908:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:2.0:1788592882.118515:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14388:1875475147366784:192.168.204.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788592882.121674:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.121861:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897792 00000100:00100000:2.0:1788592882.121875:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897792 00000100:00100000:2.0:1788592882.122017:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:2.0:1788592882.122031:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14497:x1875475136897792:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788592882.122091:0:14355:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788592882.122241:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14497:x1875475136897792:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 213us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.122250:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 39 00000100:00100000:1.0:1788592882.129990:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.131019:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136897920 00000100:00100000:0.0:1788592882.131036:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136897920 00000100:00100000:0.0:1788592882.131127:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:0.0:1788592882.131139:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14497:x1875475136897920:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.131242:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131265:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131282:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131382:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131391:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131399:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131453:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131462:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131469:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592882.131516:0:15998:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788592882.131527:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788592882.131856:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131872:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131880:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131887:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131893:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bccca400 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.131898:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131907:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131922:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981a03de600) 00010000:00010000:0.0:1788592882.131924:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592882.131930:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131936:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bccca400/0x27b316f132511ff6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131965:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131972:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131989:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.131994:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccbc00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.131997:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132003:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132011:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff898185c2da00) 00010000:00010000:0.0:1788592882.132014:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592882.132017:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132023:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccbc00/0x27b316f132511ffd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132041:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132047:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132053:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132116:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc455a00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.132120:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132137:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132146:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592882.132149:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592882.132152:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.132158:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512004 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.132335:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14497:x1875475136897920:12345-192.168.204.20@tcp:34:lhsmtool_posix.0 Request processed in 1194us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.132344:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 40 00000100:00100000:1.0:1788592882.144975:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.145123:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136898176 00000100:00100000:0.0:1788592882.145137:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136898176 00000100:00100000:0.0:1788592882.145212:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:0.0:1788592882.145224:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+24:14497:x1875475136898176:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.145253:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592882.145283:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f13251200b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ed4 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145487:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145507:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145522:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788592882.145542:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788592882.145680:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145690:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145697:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145705:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc454e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.145710:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145719:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145734:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:0.0:1788592882.145737:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788592882.145743:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.145750:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454e00/0x27b316f132512012 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.146161:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f13251200b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ed4 expref: 26 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.146176:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8981a03de600) 00010000:00010000:0.0:1788592882.146178:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788592882.146191:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f13251200b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ed4 expref: 26 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.146203:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bc455a00, rc 0) 00000100:00100000:0.0:1788592882.146285:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136898176:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 1063us (1337us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788592882.146295:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 41 00000100:00100000:3.0:1788592882.149699:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.150061:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136898304 00000100:00100000:1.0:1788592882.150075:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136898304 00000100:00100000:1.0:1788592882.150144:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1788592882.150156:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136898304:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788592882.150207:0:14354:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788592882.150377:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136898304:12345-192.168.204.20@tcp:53:lhsmtool_posix.0 Request processed in 197us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.150386:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 42 00000100:00100000:1.0:1788592882.158637:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.158819:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136898560 00000100:00100000:0.0:1788592882.158833:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136898560 00000100:00100000:0.0:1788592882.158910:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1788592882.158922:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+25:14497:x1875475136898560:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.158959:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592882.158987:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512020 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1edb expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788592882.162248:0:15998:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:1.0:1788592882.162264:0:15998:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788592882.162330:0:15998:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788592882.165764:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132512027 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.165818:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132512027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.165835:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132512027 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.165933:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455a00/0x27b316f132512020 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1edb expref: 28 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.165970:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132512027 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1edb expref: 27 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.166002:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592882.166006:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788592882.166011:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bea00, rc 0) 00000100:00100000:1.0:1788592882.166115:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+27:14497:x1875475136898560:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 7194us (7505us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788592882.166124:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 43 00000100:00100000:0.0:1788592882.175284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.175545:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136898816 00000100:00100000:1.0:1788592882.175576:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136898816 00000100:00100000:1.0:1788592882.175661:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:1.0:1788592882.175673:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+27:14497:x1875475136898816:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592882.175748:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592882.175792:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bea00/0x27b316f132512027 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1edb expref: 27 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175815:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89818289a300) 00010000:00010000:1.0:1788592882.175830:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592882.175856:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175872:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175884:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175898:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175927:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.175934:0:14354:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176019:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176028:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176036:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176042:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592882.176047:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176056:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176064:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff898185c2de00) 00010000:00010000:1.0:1788592882.176067:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592882.176071:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176078:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512035 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176087:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176098:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176105:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176110:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bf600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592882.176112:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176118:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.176125:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1bfac0a8 (ffff89818289a500) 00010000:00010000:1.0:1788592882.176127:0:14354:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788592882.176129:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.177305:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251203c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1bfac0a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14354 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.178451:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+26:14497:x1875475136898816:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 2766us (3168us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788592882.178464:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 44 00000100:00100000:3.0:1788592882.183974:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.184107:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136898944 00000100:00100000:2.0:1788592882.184121:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136898944 00000100:00100000:2.0:1788592882.184305:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:2.0:1788592882.184321:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+26:14497:x1875475136898944:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592882.184391:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592882.184425:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512043 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ee2 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184473:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f13251204a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184491:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f13251204a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184506:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f13251204a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184657:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512043 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee2 expref: 28 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184686:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04800/0x27b316f13251204a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee2 expref: 27 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.184696:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:2.0:1788592882.184700:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592882.184705:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a04800, rc 0) 00000100:00100000:2.0:1788592882.184769:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+27:14497:x1875475136898944:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 452us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.184789:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 45 00000100:00100000:3.0:1788592882.192612:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.193002:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136899200 00000100:00100000:2.0:1788592882.193015:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136899200 00000100:00100000:2.0:1788592882.193082:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 46 00000100:00100000:2.0:1788592882.193093:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+27:14497:x1875475136899200:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788592882.193220:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.193244:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.193259:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788592882.194108:0:14355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788592882.194124:0:14355:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 456434773362ns, next at 457434770309ns, rc = 0 00000004:00010000:3.0:1788592882.194252:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a4b94d reply state 000000009ed4b109 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.194284:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788592882.194457:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+29:14497:x1875475136899200:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 1362us (1856us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788592882.194466:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 46 00010000:00010000:2.0:1788592882.202738:0:3269:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202764:0:3269:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202811:0:3269:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202817:0:3269:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05e00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592882.202823:0:3269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202833:0:3269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202858:0:3269:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:2.0:1788592882.202862:0:3269:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788592882.202868:0:3269:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.202875:0:3269:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a05e00/0x27b316f132512051 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.206313:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.211380:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136899328 00000100:00100000:1.0:1788592882.211406:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136899328 00000100:00100000:0.0:1788592882.211829:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:0.0:1788592882.211844:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+28:14497:x1875475136899328:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.211878:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592882.211906:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ee9 expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.212002:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 29 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.212022:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 29 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.212075:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:0.0:1788592882.212079:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788592882.212083:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bc454800, rc 0) 00000100:00100000:0.0:1788592882.212177:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+29:14497:x1875475136899328:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 336us (5878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.212184:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 47 00000100:00100000:3.0:1788592882.219528:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.221286:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136899456 00000100:00100000:2.0:1788592882.221307:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136899456 00000100:00100000:2.0:1788592882.222574:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1788592882.222595:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2344:x1875475136899456:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788592882.223082:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2344:x1875475136899456:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 495us (3957us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788592882.223090:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592882.229922:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.230166:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136899712 00000100:00100000:1.0:1788592882.230179:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136899712 00000100:00100000:1.0:1788592882.230255:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:1.0:1788592882.230266:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+29:14497:x1875475136899712:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788592882.230993:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+30:14497:x1875475136899712:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 725us (1083us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788592882.231003:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 9 00000100:00100000:3.0:1788592882.235410:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.235757:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136899968 00000100:00100000:0.0:1788592882.235773:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136899968 00000100:00100000:0.0:1788592882.235853:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1788592882.235867:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+30:14497:x1875475136899968:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788592882.236045:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+30:14497:x1875475136899968:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 181us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.236053:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 48 00000100:00100000:0.0:1788592882.240535:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.240843:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900096 00000100:00100000:1.0:1788592882.240858:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900096 00000100:00100000:1.0:1788592882.240933:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:1.0:1788592882.240946:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+30:14497:x1875475136900096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788592882.240983:0:15998:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788592882.241012:0:15998:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251205f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ef0 expref: -99 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241104:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241122:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241137:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788592882.241722:0:15998:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788592882.241745:0:15998:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241781:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf600/0x27b316f13251205f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef0 expref: 32 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241805:0:15998:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef0 expref: 31 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.241839:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:1.0:1788592882.241842:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788592882.241846:0:15998:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981988bf800, rc 0) 00000100:00100000:1.0:1788592882.241935:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+31:14497:x1875475136900096:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 991us (1426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.241943:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 49 00000100:00100000:3.0:1788592882.245793:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.246936:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900224 00000100:00100000:2.0:1788592882.246960:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900224 00000100:00100000:2.0:1788592882.247080:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:2.0:1788592882.247094:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+6:2344:x1875475136900224:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788592882.247149:0:15039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788592882.247179:0:15039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1ef7 expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788592882.247215:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9bc2f1, blocks: 0x1 00010000:00010000:2.0:1788592882.247242:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=456s v=(0 0) 00010000:00010000:2.0:1788592882.247247:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.247259:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.247282:0:15039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.247300:0:15039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff898086a05e00, rc 0) 00000100:00100000:2.0:1788592882.247406:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2344:x1875475136900224:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 315us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.247414:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1788592882.253245:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.253377:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900480 00000100:00100000:1.0:1788592882.253390:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900480 00000100:00100000:1.0:1788592882.253455:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1788592882.253466:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+31:14497:x1875475136900480:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788592882.253633:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+31:14497:x1875475136900480:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 168us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.253640:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 50 00000100:00100000:1.0:1788592882.258252:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.258783:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900608 00000100:00100000:2.0:1788592882.258806:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900608 00000100:00100000:2.0:1788592882.258879:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:2.0:1788592882.258893:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+31:14497:x1875475136900608:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788592882.310600:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1788592882.310633:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:2.0:1788592882.310639:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:2.0:1788592882.310652:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1788592882.310675:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:2.0:1788592882.310703:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788592882.311393:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788592882.311419:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147366912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788592882.311511:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788592882.311584:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147366912 00000100:00100000:0.0:1788592882.311593:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147366912 00000100:00100000:0.0:1788592882.311658:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788592882.311668:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3283:x1875475147366912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788592882.312107:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788592882.312112:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788592882.312114:0:15040:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788592882.312116:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788592881 -> 1788592881 00002000:00010000:0.0:1788592882.312133:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788592882.312499:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3283:x1875475147366912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 830us (985us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788592882.312509:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788592882.312539:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788592882.312888:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14497:x1875475136900608:12345-192.168.204.20@tcp:44:lhsmtool_posix.0 Request processed in 53994us (54646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.312899:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 51 00000100:00100000:3.0:1788592882.315576:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.316055:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900736 00000100:00100000:0.0:1788592882.316069:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900736 00000100:00100000:0.0:1788592882.316149:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 16 00000100:00100000:0.0:1788592882.316160:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2344:x1875475136900736:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788592882.316302:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2344:x1875475136900736:12345-192.168.204.20@tcp:16:lhsmtool_posix.0 Request processed in 145us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.316310:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 16 00000004:00080000:2.0:1788592882.317411:0:3283:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff898086e51c00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788592882.317426:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3283:1875475147366912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788592882.319791:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.319971:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136900992 00000100:00100000:1.0:1788592882.319983:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136900992 00000100:00100000:1.0:1788592882.320050:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 52 00000100:00100000:1.0:1788592882.320062:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14497:x1875475136900992:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788592882.320131:0:14355:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788592882.320228:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bf800/0x27b316f132512066 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef0 expref: 14 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.320280:0:14355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:1.0:1788592882.320288:0:14355:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788592882.320329:0:14355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.320395:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.320409:0:14355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788592882.320742:0:14355:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9d37e19 reply state 0000000000adf28d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.320753:0:14355:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788592882.320958:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+15:14497:x1875475136900992:12345-192.168.204.20@tcp:36:lhsmtool_posix.0 Request processed in 888us (1170us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788592882.320967:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 52 00010000:00010000:0.0:1788592882.323132:0:3270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323232:0:3270:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323240:0:3270:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323247:0:3270:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bfe00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:0.0:1788592882.323253:0:3270:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323263:0:3270:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323286:0:3270:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:0.0:1788592882.323290:0:3270:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788592882.323315:0:3270:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.323321:0:3270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981988bfe00/0x27b316f132512074 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14355 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.325709:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.326029:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901120 00000100:00100000:0.0:1788592882.326139:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901120 00000100:00100000:0.0:1788592882.326306:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:0.0:1788592882.326322:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:14497:x1875475136901120:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.326372:0:15040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788592882.326503:0:15040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae236c080f3d1efe expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.326544:0:15040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.326555:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592882.326561:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592882.326567:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.326619:0:15040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.326635:0:15040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.326677:0:15040:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15040:1875475147367040:192.168.204.20@tcp:104: 00000100:00100000:0.0:1788592882.327475:0:15040:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236480 going to sleep for 11 seconds 00000100:00100000:0.0:1788592882.329806:0:15040:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15040:1875475147367040:192.168.204.20@tcp:104: 00010000:00010000:0.0:1788592882.329860:0:15040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.330065:0:15040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8981bc455e00, rc 0) 00000100:00100000:0.0:1788592882.330264:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:14497:x1875475136901120:12345-192.168.204.20@tcp:101:lhsmtool_posix.0 Request processed in 3944us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788592882.330276:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 17 00000100:00100000:3.0:1788592882.331506:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.331702:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901248 00000100:00100000:2.0:1788592882.331713:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901248 00010000:00010000:2.0:1788592882.331763:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.331875:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:2.0:1788592882.331886:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2344:x1875475136901248:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788592882.331905:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788592882.331935:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.331962:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.331992:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f13251206d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ef7 expref: 8 pid: 15039 timeout: 556 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.332013:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.332017:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.332025:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 7 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.332037:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 7 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.332106:0:14341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 7 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.332122:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14341:1875475147367168:192.168.204.20@tcp:105: 00000100:00100000:2.0:1788592882.332455:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff898193b88900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592882.338422:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14341:1875475147367168:192.168.204.20@tcp:105: 00010000:00010000:2.0:1788592882.339531:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788592882.339783:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2344:x1875475136901248:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 7893us (8280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.339809:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 13 00000100:00100000:3.0:1788592882.340227:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.341980:0:15038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901376 00000100:00100000:0.0:1788592882.341998:0:15038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901376 00000100:00100000:0.0:1788592882.342084:0:15038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:0.0:1788592882.342096:0:15038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2343:x1875475136901376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788592882.342387:0:15038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788592882.342392:0:15038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788592881 00002000:00010000:0.0:1788592882.342396:0:15038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788592880 00002000:00010000:0.0:1788592882.342398:0:15038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788592881 -> 1788592881 00002000:00010000:0.0:1788592882.342401:0:15038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788592882.342486:0:15038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2343:x1875475136901376:12345-192.168.204.20@tcp:2:lhsmtool_posix.0 Request processed in 391us (2260us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788592882.342494:0:15038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 18 00000100:00100000:1.0:1788592882.346853:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.346996:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901504 00000100:00100000:2.0:1788592882.347009:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901504 00000100:00100000:2.0:1788592882.347083:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:2.0:1788592882.347095:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2342:x1875475136901504:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788592882.347170:0:16006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.347197:0:16006:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.347206:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.347211:0:16006:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788592882.347216:0:16006:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.347284:0:16006:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 8 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.347301:0:16006:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 8 pid: 15040 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.347317:0:16006:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16006:1875475147367296:192.168.204.20@tcp:104: 00000100:00100000:2.0:1788592882.347459:0:16006:0:(client.c:2716:ptlrpc_set_wait()) set ffff898193b88900 going to sleep for 11 seconds 00000100:00100000:2.0:1788592882.350160:0:16006:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16006:1875475147367296:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592882.350201:0:16006:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.351963:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.352202:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901632 00000100:00100000:3.0:1788592882.352214:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901632 00010000:00010000:3.0:1788592882.352270:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 9 pid: 15040 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.352326:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 14 00000100:00100000:3.0:1788592882.352338:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:2344:x1875475136901632:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592882.352401:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592882.352435:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 9 pid: 15040 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.352476:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 9 pid: 15040 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.352506:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000456a9d28/0x27b316f13251207b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1efe expref: 9 pid: 15040 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.352527:0:14342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592882.352533:0:14342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788592882.352541:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.352563:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.352606:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592882.352684:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2344:x1875475136901632:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 348us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592882.352692:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 14 00010000:00010000:2.0:1788592882.353464:0:16006:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353480:0:16006:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353519:0:16006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353528:0:16006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353567:0:16006:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353574:0:16006:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05e00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592882.353580:0:16006:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353592:0:16006:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353611:0:16006:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.353634:0:16006:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024fc738f/0x27b316f132512082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.353732:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2342:x1875475136901504:12345-192.168.204.20@tcp:1:lhsmtool_posix.0 Request processed in 6636us (6893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.353741:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 19 00000100:00100000:1.0:1788592882.357903:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.358173:0:15998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136901888 00000100:00100000:0.0:1788592882.358203:0:15998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136901888 00000100:00100000:0.0:1788592882.358274:0:15998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 53 00000100:00100000:0.0:1788592882.358285:0:15998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:14497:x1875475136901888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788592882.358598:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.358621:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.358636:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.358995:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.359010:0:15998:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 15 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.359019:0:15998:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.359061:0:15998:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 15 pid: 15998 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.359078:0:15998:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 15 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.359095:0:15998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898086e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147367424:192.168.204.20@tcp:104: 00000100:00100000:1.0:1788592882.360859:0:15998:0:(client.c:2716:ptlrpc_set_wait()) set ffff898185236480 going to sleep for 11 seconds 00000100:00100000:1.0:1788592882.369223:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.369408:0:16469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902016 00000100:00100000:3.0:1788592882.369437:0:16469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902016 00010000:00010000:3.0:1788592882.369492:0:16469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 16 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.369544:0:16469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15 00000100:00100000:3.0:1788592882.369556:0:16469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+16:2344:x1875475136902016:12345-192.168.204.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788592882.369595:0:16469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788592882.369604:0:16469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 16 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.369621:0:16469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 16 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.369777:0:16469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:3.0:1788592882.369784:0:16469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.369799:0:16469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.369807:0:16469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.369838:0:16469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788592882.370030:0:16469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+16:2344:x1875475136902016:12345-192.168.204.20@tcp:103:ldlm_bl.0 Request processed in 475us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592882.370038:0:16469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15 00010000:00010000:2.0:1788592882.370244:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454800/0x27b316f132512058 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ee9 expref: 15 pid: 15998 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.370268:0:15998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898086e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147367424:192.168.204.20@tcp:104: 00010000:00010000:2.0:1788592882.370297:0:15998:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.370318:0:15998:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.370324:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788592882.370812:0:15998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788592882.371018:0:15998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788592882.371072:0:15998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788592882.371181:0:15998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15998:1875475147367552:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788592882.371681:0:15998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592882.371764:0:15998:0:(client.c:2716:ptlrpc_set_wait()) set ffff898184f9f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788592882.372255:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147367552 00000100:00100000:3.0:1788592882.372268:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147367552 00000100:00100000:3.0:1788592882.372330:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592882.372340:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15998:x1875475147367552:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788592882.372492:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15998:x1875475147367552:12345-0@lo:1000:mdt00_003.0 Request processed in 152us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592882.372500:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788592882.372560:0:15998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc5d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15998:1875475147367552:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788592882.374866:0:15998:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788592882.375161:0:15998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15998:1875475147367680:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788592882.375248:0:15998:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592882.375406:0:15998:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788592882.375770:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147367680 00000100:00100000:3.0:1788592882.375780:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147367680 00000100:00100000:3.0:1788592882.375903:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788592882.376001:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15998:x1875475147367680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788592882.376341:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15998:x1875475147367680:12345-0@lo:1000:mdt00_003.0 Request processed in 345us (1092us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788592882.376366:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788592882.376707:0:15998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15998:1875475147367680:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788592882.376762:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376775:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376788:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376853:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc454600 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592882.376860:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376871:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376894:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:1.0:1788592882.376898:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592882.376904:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.376993:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454600/0x27b316f132512090 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377037:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377045:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377050:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377066:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bcccb200 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:1.0:1788592882.377069:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377076:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377087:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:1.0:1788592882.377089:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788592882.377097:0:15998:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377112:0:15998:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377123:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.377193:0:15998:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb000/0x27b316f132511fef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0xae236c080f3d1ecd expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.377209:0:15998:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147367808:192.168.204.20@tcp:105: 00000100:00100000:1.0:1788592882.377314:0:15998:0:(client.c:2716:ptlrpc_set_wait()) set ffff89819112c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788592882.386223:0:15998:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15998:1875475147367808:192.168.204.20@tcp:105: 00010000:00010000:2.0:1788592882.386266:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386277:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bcccb200/0x27b316f132511fe8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386323:0:15998:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386337:0:15998:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386431:0:15998:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386445:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386472:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386484:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386491:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a04c00 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592882.386496:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386504:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386520:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592882.386523:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788592882.386528:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386535:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff898086a04c00/0x27b316f132512097 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386550:0:15998:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386557:0:15998:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386563:0:15998:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386570:0:15998:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc455800 already unused, calling callback (ffffffffc213a4f0) 00010000:00010000:2.0:1788592882.386582:0:15998:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386591:0:15998:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386602:0:15998:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff898185c2df00) 00010000:00010000:2.0:1788592882.386605:0:15998:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788592882.386608:0:15998:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.386614:0:15998:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc455800/0x27b316f132512089 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15998 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.386922:0:15998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898184e5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:14497:x1875475136901888:12345-192.168.204.20@tcp:57:lhsmtool_posix.0 Request processed in 28636us (29033us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788592882.386935:0:15998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 53 00000020:00080000:2.0:1788592882.386941:0:15998:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788592882.387454:0:14388:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788592882.387460:0:14388:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788592882.387489:0:14388:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788592882.387495:0:14388:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788592882.387856:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1788592882.387955:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902144 00000100:00100000:2.0:1788592882.387964:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902144 00000100:00100000:2.0:1788592882.388024:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:2.0:1788592882.388035:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89819117e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:14496:x1875475136902144:12345-192.168.204.20@tcp:49:dd.0 00000100:00100000:2.0:1788592882.388178:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89819117e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:14496:x1875475136902144:12345-192.168.204.20@tcp:49:dd.0 Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592882.388186:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 10 00000100:00100000:3.0:1788592882.389844:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1788592882.389924:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902400 00000100:00100000:1.0:1788592882.389937:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902400 00000100:00100000:1.0:1788592882.389994:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 11 00000100:00100000:1.0:1788592882.390004:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:14497:x1875475136902400:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788592882.404782:0:14357:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788592882.404891:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788592882.412338:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412401:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412414:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412424:0:14357:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412430:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412437:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.412472:0:14357:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788592882.412528:0:14343:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788592882.412545:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.412556:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc454400 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592882.412561:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.412573:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.412594:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8981906ae200) 00010000:00010000:3.0:1788592882.412598:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788592882.412604:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.412610:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8981bc454400/0x27b316f13251209e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.412626:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+20:14497:x1875475136902400:12345-192.168.204.20@tcp:35:lhsmtool_posix.0 Request processed in 22615us (22787us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788592882.412653:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 11 00000020:00080000:0.0:1788592882.412662:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788592882.412669:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592882.412673:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592882.412676:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788592882.559564:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788592882.602417:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.602789:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902528 00000100:00100000:0.0:1788592882.602801:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902528 00000100:00100000:0.0:1788592882.602881:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 0 00000100:00100000:0.0:1788592882.602893:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2344:x1875475136902528:12345-192.168.204.20@tcp:4:dd.0 00002000:00010000:0.0:1788592882.602958:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9bc2f1, atime: 0x6a9bc2f0, ctime: 0x6a9bc2f1, blocks: 0x1 00010000:00010000:0.0:1788592882.602968:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.602983:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=456s v=(0 0) 00010000:00010000:0.0:1788592882.602995:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592882.603003:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.603018:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.604151:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.604206:0:15045:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788592882.604223:0:15045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788592882.605568:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902656 00000100:00100000:0.0:1788592882.605580:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902656 00000100:00100000:3.0:1788592882.606699:0:16584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:3.0:1788592882.606714:0:16584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:2344:x1875475136902656:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:3.0:1788592882.606755:0:16584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.606774:0:16584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.606779:0:16584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.606786:0:16584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.606800:0:16584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.619934:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.620183:0:15045:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788592882.620195:0:15045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788592882.621850:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902784 00000100:00100000:3.0:1788592882.621867:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902784 00000100:00100000:1.0:1788592882.622888:0:16585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2 00000100:00100000:1.0:1788592882.622911:0:16585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+11:2343:x1875475136902784:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:1.0:1788592882.622967:0:16585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.622985:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592882.622991:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788592882.622997:0:16585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.623013:0:16585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592882.720104:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788592882.720125:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788592882.720141:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1788592882.720152:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1788592882.721438:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788592882.721449:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1788592882.721470:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.721510:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.721520:0:15043:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.721528:0:15043:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc455000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592882.721534:0:15043:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.721558:0:15043:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.724543:0:15043:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.724560:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d6bdb80/0x27b316f1325120a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592882.726060:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+13:2344:x1875475136902528:12345-192.168.204.20@tcp:4:dd.0 Request processed in 123153us (123702us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788592882.726085:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 0 00000001:00080000:3.0:1788592882.781488:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:3.0:1788592882.781523:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788592882.781588:0:16585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:3.0:1788592882.781608:0:16585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781641:0:16585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781653:0:16585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781660:0:16585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981988bea00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592882.781667:0:16585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781678:0:16585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781707:0:16585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.781717:0:16585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8fa9fde/0x27b316f1325120b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.781834:0:16585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+7:2343:x1875475136902784:12345-192.168.204.20@tcp:4:dd.0 Request processed in 158925us (161904us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788592882.781846:0:16585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2 00010000:00010000:1.0:1788592882.782119:0:16584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782129:0:16584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782137:0:16584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782143:0:16584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762ec00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:1.0:1788592882.782157:0:16584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782166:0:16584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782179:0:16584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788592882.782187:0:16584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff8c5c6c/0x27b316f1325120ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788592882.782242:0:16584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2344:x1875475136902656:12345-192.168.204.20@tcp:4:dd.0 Request processed in 175531us (178102us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788592882.782251:0:16584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 1 00000100:00100000:2.0:1788592882.788539:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.788683:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136902912 00000100:00100000:3.0:1788592882.788695:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136902912 00000100:00100000:3.0:1788592882.788766:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1788592882.788776:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2342:x1875475136902912:12345-192.168.204.20@tcp:4:dd.0 00002000:00010000:3.0:1788592882.788861:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9bc2f1, atime: 0x6a9bc2f0, ctime: 0x0, blocks: 0x1807 00010000:00010000:3.0:1788592882.788872:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.788892:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1788592882.788897:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.788904:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.788921:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.794960:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.795050:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.799367:0:16585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136903040 00000100:00100000:0.0:1788592882.799389:0:16585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136903040 00000100:00100000:0.0:1788592882.799488:0:16585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136903168 00000100:00100000:0.0:1788592882.799492:0:16585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136903168 00000100:00100000:0.0:1788592882.799529:0:16585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4 00000100:00100000:0.0:1788592882.799542:0:16585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2342:x1875475136903040:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:0.0:1788592882.799592:0:16585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.799615:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592882.799621:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788592882.799629:0:16585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788592882.799649:0:16585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.799911:0:16584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 5 00000100:00100000:3.0:1788592882.799923:0:16584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+8:2342:x1875475136903168:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:3.0:1788592882.799955:0:16584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.799964:0:16584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.799967:0:16584:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.799973:0:16584:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.799984:0:16584:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.800404:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1788592882.800472:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1788592882.803093:0:15044:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788592882.803115:0:15044:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1788592882.806958:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788592882.807164:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136903424 00000100:00100000:2.0:1788592882.807178:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136903424 00000100:00100000:2.0:1788592882.807259:0:15043:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788592882.807265:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475136903296 00000100:00100000:2.0:1788592882.807269:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475136903296 00000100:00100000:2.0:1788592882.814776:0:16587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 6 00000100:00100000:2.0:1788592882.814804:0:16587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+14:2341:x1875475136903424:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:2.0:1788592882.814851:0:16587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.814869:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.814873:0:16587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788592882.814880:0:16587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592882.814896:0:16587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788592882.905190:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1788592882.905281:0:15045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:3.0:1788592882.905287:0:15045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788592881 -> 1788592882 00002000:00010000:3.0:1788592882.905290:0:15045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788592882 00002000:00010000:3.0:1788592882.905292:0:15045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788592882.905312:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905328:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905337:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905344:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762f200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592882.905391:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905404:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905433:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905466:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004437cf82/0x27b316f1325120ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592882.905588:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bf4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+18:2342:x1875475136902912:12345-192.168.204.20@tcp:4:dd.0 Request processed in 116805us (117055us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788592882.905599:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 3 00000100:00100000:3.0:1788592882.905640:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:3.0:1788592882.905654:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+17:2341:x1875475136903296:12345-192.168.204.20@tcp:4:dd.0 00010000:00010000:3.0:1788592882.905696:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905711:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.905716:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788592882.905724:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592882.905740:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788592882.943592:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788592882.943623:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147367936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788592882.943756:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592882.944014:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147367936 00000100:00100000:1.0:1788592882.944024:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147367936 00000100:00100000:1.0:1788592882.944102:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592882.944113:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff898086e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147367936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788592882.944159:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788592882.944229:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff898086e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147367936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788592882.944237:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788592882.944293:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147367936:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788592882.944487:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1788592883.001183:0:16585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1788592883.001211:0:16585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.001226:0:16585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.001500:0:16585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.001506:0:16587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.001515:0:16587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.001523:0:16587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788592883.001574:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00010000:00010000:3.0:1788592883.002072:0:16585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8981bc455200 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592883.002081:0:16585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002095:0:16585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002124:0:16585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002134:0:16585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005875491b/0x27b316f1325120c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592883.002300:0:16585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+13:2342:x1875475136903040:12345-192.168.204.20@tcp:4:dd.0 Request processed in 202754us (207359us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788592883.002312:0:16585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4 00010000:00010000:3.0:1788592883.002423:0:16584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002434:0:16584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002459:0:16584:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002467:0:16584:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762fc00 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592883.002471:0:16584:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002480:0:16584:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002492:0:16584:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.002500:0:16584:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000827a04ab/0x27b316f1325120c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592883.002535:0:16584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc5d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+11:2342:x1875475136903168:12345-192.168.204.20@tcp:4:dd.0 Request processed in 202614us (207484us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788592883.002543:0:16584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 5 00010000:00010000:2.0:1788592883.005959:0:16587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff898086a05800 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:2.0:1788592883.005978:0:16587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.006023:0:16587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.006051:0:16587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788592883.006061:0:16587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039ee721d/0x27b316f1325120cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788592883.006169:0:16587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+9:2341:x1875475136903424:12345-192.168.204.20@tcp:4:dd.0 Request processed in 191370us (205761us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788592883.006180:0:16587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 6 00000001:00080000:0.0:1788592883.054954:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1788592883.055725:0:15045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788592883.055749:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055765:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055871:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055878:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89819762e000 already unused, calling callback (ffffffffc172b4f0) 00010000:00010000:3.0:1788592883.055883:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055893:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055919:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788592883.055927:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8713147/0x27b316f1325120d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788592883.056071:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a90ce23a-7f0a-432b-b6d0-4c3ffc646ddf+5:2341:x1875475136903296:12345-192.168.204.20@tcp:4:dd.0 Request processed in 150414us (255589us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788592883.056083:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 7 00000100:00100000:1.0:1788592883.454933:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147368064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788592883.455034:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592883.456431:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147368064 00000100:00100000:3.0:1788592883.456448:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147368064 00000100:00100000:3.0:1788592883.456515:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788592883.456527:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147368064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788592883.456563:0:15042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1788592883.456665:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1875475147368064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592883.456687:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788592883.456772:0:3286:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1788592883.456851:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff898086e51c00, transno 8589934595 00000004:00080000:1.0:1788592883.456919:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1788592883.456974:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3286:1875475147368064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788592883.457411:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147368192:0@lo:400:kworker.0 00000100:00100000:1.0:1788592883.457411:0:3284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147368320:0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.457460:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592883.457460:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788592883.457511:0:3286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff898183e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147368576:0@lo:400:kworker.0 00000100:00100000:2.0:1788592883.457587:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147368192 00000100:00100000:2.0:1788592883.457595:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147368192 00000100:00100000:2.0:1788592883.457646:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788592883.457655:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bbb67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3283:x1875475147368192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.459919:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147368320 00000100:00100000:3.0:1788592883.459946:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147368320 00000100:00100000:3.0:1788592883.460018:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592883.460028:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147368320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.460128:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1875475147368320:12345-0@lo:400:kworker.0 Request processed in 102us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592883.460137:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788592883.460205:0:3285:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147368448:0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.460258:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788592883.460337:0:3284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3284:1875475147368320:0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.460392:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147368448 00000100:00100000:3.0:1788592883.460397:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147368448 00000100:00100000:3.0:1788592883.460437:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592883.460443:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bca9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147368448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.460484:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bca9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1875475147368448:12345-0@lo:400:kworker.0 Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592883.460490:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788592883.460515:0:3285:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8981bc7c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3285:1875475147368448:0@lo:400:kworker.0 00000100:00080000:3.0:1788592883.460548:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788592883.461745:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788592883.463201:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bbb67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7e8219ee-ba92-4a43-886c-289e43c7369c+19:3283:x1875475147368192:12345-0@lo:400:kworker.0 Request processed in 5537us (5730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788592883.463218:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788592883.463745:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898184e59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7e8219ee-ba92-4a43-886c-289e43c7369c:3283:1875475147368192:0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.465381:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875475147368576 00000100:00100000:3.0:1788592883.465399:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875475147368576 00000100:00100000:3.0:1788592883.465498:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788592883.465692:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8981bc7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147368576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788592883.465883:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8981bc7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1875475147368576:12345-0@lo:400:kworker.0 Request processed in 195us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788592883.465891:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788592883.466017:0:3286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff898183e99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3286:1875475147368576:0@lo:400:kworker.0 00000100:00080000:0.0:1788592883.466158:0:14351:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788592883.582705:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788592884.606611:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788592884.632870:0:16624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788592885.634390:0:14343:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29447 lines, 29447 kept, 0 dropped, 0 bad.